Parallel concatenated code with soft-in soft-out interactive turbo decoder

ABSTRACT

A method for parallel concatenated (Turbo) encoding and decoding. Turbo encoders receive a sequence of input data tuples and encode them. The input sequence may correspond to a sequence of an original data source, or to an already coded data sequence such as provided by a Reed-Solomon encoder. A turbo encoder generally comprises two or more encoders separated by one or more interleavers. The input data tuples may be interleaved using a modulo scheme in which the interleaving is according to some method (such as block or random interleaving) with the added stipulation that the input tuples may be interleaved only to interleaved positions having the same modulo-N (where N is an integer) as they have in the input data sequence. If all the input tuples are encoded by all encoders then output tuples can be chosen sequentially from the encoders and no tuples will be missed. If the input tuples comprise multiple bits, the bits may be interleaved independently to interleaved positions having the same modulo-N and the same bit position. This may improve the robustness of the code. A first encoder may have no interleaver or all encoders may have interleavers, whether the input tuple bits are interleaved independently or not. Modulo type interleaving also allows decoding in parallel.

CROSS-REFERENCE TO RELATED APPLICATION(S)

[0001] This application claims priority from provisional applications“TURBO TRELLIS ENCODER AND DECODER” serial No. 60/232,053 filed on Sep.12, 2000, and from “PARALLEL CONCATENATED CODE WITH SISO INTERACTIVETURBO DECODER serial No. 60/232,288 filed on Sep. 12, 2000. Both ofwhich are incorporated by reference herein as though set forth in full.This application also claims priority to application PARALLELCONCATENATED CODE WITH SOFT-IN SOFT-OUT INTERACTIVE TURBO DECODER Ser.No.09/878,148, Filed Jun. 8, 2001, which is incorporated by reference asthough set forth in full.

FIELD OF THE INVENTION

[0002] The invention relates to methods, apparatus, and signals used inchannel coding and decoding, and, in particular embodiments to methods,apparatus and signals for use with turbo and turbo-trellis encoding anddecoding for communication channels.

BACKGROUND OF THE INVENTION

[0003] A significant amount of interest has recently been paid tochannel coding. For example a recent authoritative text states:

[0004] “Channel coding refers to the class of signal transformationsdesigned to improve communications performance by enabling thetransmitted signals to better withstand the effects of various channelimpairments, such as noise, interference, and fading. Thesesignal-processing techniques can be thought of as vehicles foraccomplishing desirable system trade-offs (e.g., error-performanceversus bandwidth, power versus bandwidth). Why do you suppose channelcoding has become such a popular way to bring about these beneficialeffects? The use of large-scale integrated circuits (LSI) and high-speeddigital signal processing (DSP) techniques have made it possible toprovide as much as 10 dB performance improvement through these methods,at much less cost than through the use of most other methods such ashigher power transmitters or larger antennas.”

[0005] From “Digital Communications” Fundamentals and ApplicationsSecond Edition by Bernard Sklar, page 305 ©2001 Prentice Hall PTR.

[0006] Stated differently, improved coding techniques may providesystems that can operate at lower power or may be used to provide higherdata rates.

Conventions and Definitions

[0007] Particular aspects of the invention disclosed herein depend uponand are sensitive to the sequence and ordering of data. To improve theclarity of this disclosure the following convention is adopted. Usually,items are listed in the order that they appear. Items listed as #1, #2,#3 are expected to appear in the order #1, #2, #3 listed, in agreementwith the way they are read, i.e. from left to right. However, inengineering drawings, it is common to show a sequence being presented toa block of circuitry, with the right most tuple representing theearliest sequence, as shown in FIG. 2, where 207 is the earliest tuple,followed by tuple 209. The IEEE Standard Dictionary of Electrical andElectronics Terms, Sixth Edition, defines tuple as a suffix meaning anordered set of terms (sequence) as in N-tuple. A tuple as used herein ismerely a grouping of bits having a relationship to each other.

[0008] Herein, the convention is adopted that items, such as tuples willbe written in the same convention as the drawings. That is in the orderthat they sequentially proceed in a circuit. For example, “Tuples 207and 209 are accepted by block 109” means tuple 207 is accepted first andthen 209 is accepted, as is seen in FIG. 2. In other words the text willreflect the sequence implied by the drawings. Therefore a description ofFIG. 2 would say “tuples 207 and 209 are provided to block 109” meaningthat tuple 207 is provided to block 109 before tuple 209 is provided toblock 109.

[0009] Herein an interleaver is defined as a device having an input andan output. The input accepting data tuples and the output providing datatuples having the same component bits as the input tuples, except fororder.

[0010] An integral tuple (IT) interleaver is defined as an interleaverthat reorders tuples that have been presented at the input, but does notseparate the component bits of the input tuples. That is the tuplesremain as integral units and adjacent bits in an input tuple will remainadjacent, even though the tuple has been relocated. The tuples, whichare output from an IT interleaver are the same as the tuples input tointerleaver, except for order. Hereinafter when the term interleaver isused, an IT interleaver will be meant.

[0011] A separable tuple (ST) interleaver is defined as an interleaverthat reorders the tuples input to it in the same manner as an ITinterleaver, except that the bits in the input tuples are interleavedindependently, so that bits that are adjacent to each other in an inputtuple are interleaved separately and are interleaved into differentoutput tuples. Each bit of an input tuple, when interleaved in an STinterleaver, will typically be found in a different tuple than the otherbits of the input tuple from where it came. Although the input bits areinterleaved separately in an ST interleaver, they are generallyinterleaved into the same position within the output tuple as theyoccupied within the input tuple. So for example, if an input tuplecomprising two bits, a most significant bit and a least significant bit,is input into an ST interleaver the most significant bit will beinterleaved into the most significant bit position in a first outputtuple and the least significant bit will be interleaved into the leastsignificant bit position in a second output tuple.

[0012] Modulo-N sequence designation is a term meaning the modulo-N ofthe position of an element in a sequence. If there are k item s^((I)) ina sequence then the items have ordinal numbers 0 to k−1, i.e. I₀ throughI_((k−1)) representing the position of each time in the sequence. Thefirst item in the sequence occupies position 0, the second item in asequence I₁ occupies position 1, the third item in the sequence I₂occupies position 2 and so forth up to item I_(k−1), which occupies thek'th or last position in the sequence. The modulo-N sequence designationis equal to the position of the item in the sequence modulo-N. Forexample, the modulo-2 sequence designation of I₀=0, the modulo-2sequence designation of I₁=1 and the modulo-2 sequence designation ofI₂=0 and so forth.

[0013] A modulo-N interleaver is defined as an interleaver wherein theinterleaving function depends on the modulo-N value of the tuple inputto the interleaver. Modulo interleavers are further defined andillustrated herein.

[0014] A modulo-N encoding system is one that employs one or more modulointerleavers.

SUMMARY OF PREFERRED EMBODIMENTS OF THE INVENTION

[0015] In one aspect of the invention a method for encoding aninformation signal is disclosed. The method includes nonsystematicallyencoding the information signal, interleaving the information signal toform an interleaved information signal and encoding the interleavedinformation signal.

[0016] In another aspect of the invention a method for encoding aninformation signal is disclosed. The method includes encoding theinformation signal, interleaving the information signal to form aninterleaved information signal; and nonsystematically encoding theinterleaved information signal.

[0017] In another aspect of the invention a method for encoding aninformation signal is disclosed. The method includes encoding theinformation signal, modulo-N interleaving the information signal (whereN is an integer greater than one), and encoding the modulo interleavedinformation signal.

[0018] In another aspect of the invention a method for parallelconcatenated encoding an information signal is disclosed. The methodincludes turbo trellis encoding an information signal, mapping theencoded information signal in a first mapper; and concatenating theencoded signal mapped in the first mapper with another signal mapped ina second mapper. In another aspect of the invention a method forinterleaving a first block of data tuples to create a second block ofdata tuples is disclosed. The method includes identifying a modulosequence designation for each data tuple in the first block, andinterleaving the data tuples from the first block into positions in thesecond block having the same modulo sequence designation.

[0019] In another aspect of the invention a method for encoding datatuples is disclosed. The method includes ST interleaving the data tuplesin a first even-odd interleaver, encoding in a first encoder the datatuples interleaved in the first interleaver ST interleaving the datatuples in a second even-odd interleaver, encoding in a second encoderthe data tuples interleaved in the second interleaver and selectingencoded tuples alternatively from the first and second encoder.

[0020] In another aspect of the invention a method for encoding datatuples is disclosed. The method includes encoding the data tuples in afirst encoder, interleaving the data tuples in an even/odd interleaver,encoding the interleaved tuples in a second encoder and selectingencoded tuples alternatively from the first and second encoder.

[0021] In another aspect of the invention a method of encoding datasymbols is disclosed. The method includes dividing a data tuple into asequential sequence of equally sized tuples of N input bits, the tuplesbeing of size N regardless of the size of the data tuple and turbotrellis modulated encoding the equally sized tuples.

[0022] In another aspect of the invention a method for producing a codefrom a sequence of tuples is disclosed. The method includes encoding thesequence of tuples in a first encoding, modulo interleaving the inputtuples in at least one interleaving, encoding the modulo interleavedtuples in at least one encoding, selecting the encoded tuplessequentially from each encoding and mapping the selected tuples in atleast one mapper.

[0023] In another aspect of the invention a method for creating aparallel concatenated code having a higher rate than the constituentencodings is disclosed. The method includes TTCM encoding informationtuples, mapping a first portion of the encoded information tuples in afirst mapping, puncturing a second portion of the encoded tuples andsubstituting uncoded tuples, and mapping the uncoded tuples in a secondmapping.

[0024] In another aspect of the invention a method for selectingmappings in a TTCM encoder is disclosed. The method includes selectingnon-Ungerboeck mappings, computing the average effective distancebetween code words in each mapping, and selecting the non-Ungerboeckmapping which has approximately the greatest effective distance betweencode words.

[0025] In another aspect of the invention a method for generating amodulo-N interleaving sequence is disclosed. The method includesselecting a range of addresses from 0 to M for a seed interleavingsequence, creating N interleaving sequences from the seed sequence,creating a first sequence by selecting elements sequentially from the Ninterleaving sequences, multiplying each element in the first sequenceby N to create a second sequence, and adding the element positionmodulo-N to each element in the second sequence to generate the modulo-Ninterleaving sequence.

[0026] In another aspect of the invention a method for communicatingdata is disclosed. The method includes modulo-N turbo-encoding the data,communicating the data across a channel and modulo-N decoding the data.

[0027] In another aspect of the invention a method for creating a higherrate code from a lower rate encoder constituent encoder, The methodincludes turbo trellis code modulation modulo-N encoding an inputsequence of tuples to produce an output sequence of tuples andpuncturing the output sequence and substituting uncoded input sequencetuples for corresponding encoded output sequence tuples.

[0028] In another aspect of the invention a method for selecting aconstellation mapping for a Turbo-Trellis Encoder is disclosed. Themethod includes selecting non-Ungerboeck mappings, determining theeffective minimum distance of code words in the non-Ungerboeck mappingsand selecting the non-Ungerboeck mapping having code words with thelargest effective average distance form each other.

[0029] In another aspect of the invention a method encoding data tuplesis disclosed. The method includes encoding the data tuples with aReed-Solomon encoder and turbo trellis encoding the tuples encoded withthe Reed-Solomon code.

[0030] In another aspect of the invention an apparatus for encoding aninformation signals is disclosed. The apparatus includes a nonsystematicencoder that accepts an information signal, an interleaver thatinterleaves the information signal to form an interleaved informationsignal and an encoder that encodes the interleaved information signal.In another aspect of the invention an apparatus for encoding aninformation signal is disclosed. The apparatus includes an encoder thatencodes the information signal, an interleaver that interleaves theinformation signal to form an interleaved information signal and anonsystematic encoder that encodes the interleaved information signal.

[0031] In another aspect of the invention an apparatus for encoding aninformation signal is disclosed. The apparatus includes an encoder thatencodes the information signal, a modulo-N interleaver that encodes theinformation signal, where N is an integer greater than one and anencoder that encodes the modulo interleaved information signal.

[0032] In another aspect of the invention an apparatus for parallelconcatenated encoding an information signal is disclosed. The apparatusincludes a turbo trellis encoder that encodes an information signal, afirst mapper that accepts the encoded information signal, a secondmapper that accepts the encoded information signal, a selector thatselects a first signal mapped in the first mapper and selects a secondsignal mapped in the second mapper and means for concatenating theencoded signal mapped in the first mapper with the signal mapped in asecond mapper.

[0033] In another aspect of the invention an apparatus for interleavinga first block of data tuples to create a second block of data tuples isdisclosed. The apparatus includes means for identifying a modulosequence designation for each data tuple in the first block and meansfor interleaving the data tuples from the first block into positions inthe second block having the same modulo sequence designation.

[0034] In another aspect of the invention an apparatus for encoding datatuples is disclosed. The apparatus includes an ST even-odd interleaverthat accepts the data tuples to be encoded, an encoder that encodestuples output from the ST even-odd interleaver, a second ST even-oddinterleaver that accepts the data tuples to be encoded, a second encoderthat encodes tuples output from the ST even-odd interleaver and aselector that selects encoded tuples alternatively from the first andsecond encoder.

[0035] In another aspect of the invention an apparatus for encoding datatuples is disclosed. The apparatus includes a first encoder that encodesthe data tuples, an odd-even interleaver that interleaves the datatuples, a second encoder that encodes the interleaved tuples and aselector that selects encoded tuples alternatively from the first andsecond encoders thereby providing a composite signal.

[0036] In another aspect of the invention an apparatus for encoding datatuples is disclosed. The apparatus includes a divider that divides thedata tuples into a sequential sequence of equally sized tuples of Ninput bits, the tuples being of size N regardless of the size of thedata tuple and a turbo trellis modulator that encodes the equally sizedtuples.

[0037] In another aspect of the invention an apparatus that produces acode from a sequence of tuples is disclosed. The apparatus includes afirst encoder that encodes the sequence of tuples in a first encoding,at least one modulo interleaver that interleaves the input tuples in atleast one interleaving, at least one second encoder that encodes themodulo interleaved tuples in at least one encoding, a selector thatselects encoded tuples sequentially from each encoding and at least onemapper that maps the selected tuples.

[0038] In another aspect of the invention an apparatus that creates aparallel concatenated code having a higher rate than the constituentencodings is disclosed. The apparatus includes a TTCM encoder thataccepts information tuples, a mapper that maps a first portion of theencoded information tuples in a first mapping, puncturing means forpuncturing a second portion of the encoded tuples and substitutinguncoded tuples, and a mapper that maps the uncoded tuples in a secondmapping.

[0039] In another aspect of the invention an apparatus for communicatingdata is disclosed. The apparatus includes a modulo-N turbo-encoder thataccepts the data to be communicated and produces encoded data to becommunicated, means for communicating the encoded data to becommunicated across a channel and a modulo-N decoder that accepts anddecodes the encoded data received from the channel.

[0040] In another aspect of the invention an apparatus for creating ahigher rate code from a lower rate encoder constituent encoder isdisclosed. The apparatus includes a turbo trellis code modulationmodulo-N encoder that accepts an input sequence of tuples and producesan output sequence of tuples and means for puncturing the outputsequence and substituting uncoded input sequence tuples forcorresponding encoded output sequence tuples.

[0041] In another aspect of the invention an apparatus that encodes datatuples is disclosed. The apparatus includes a Reed-Solomon encoder thatencodes the data tuples and a turbo trellis encoder that accepts thetuples encoded with the Reed-Solomon encoder.

BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The features, aspects, and advantages of the present inventionwhich have been described in the above summary will be better understoodwith regard to the following description, appended claims, andaccompanying drawings where:

[0043]FIG. 1 is a graphical illustration of an environment in whichembodiments of the present invention may operate.

[0044]FIG. 2 is a block diagram of a portion of a signal encoderaccording to an embodiment of the invention.

[0045]FIG. 3 is a block diagram of a parallel concatenated (turbo)encoder, illustrating the difference between systematic andnonsystematic forms.

[0046]FIG. 4 is a schematic diagram of a rate ⅔ “feed forward”convolutional nonsystematic encoder.

[0047]FIG. 5 is a schematic diagram of a rate ⅔ “recursive”convolutional nonsystematic encoder.

[0048]FIG. 6 is a trellis diagram of the convolutional encoderillustrated in FIG. 5.

[0049]FIG. 7 is a block diagram of a turbo-trellis coded modulation(TTCM) encoder.

[0050]FIG. 8A is a block diagram of a TTCM encoder utilizing multipleinterleavers.

[0051]FIG. 8B is a graphical illustration of the process of modulointerleaving.

[0052]FIG. 8C is a further graphical illustration of the process ofmodulo interleaving.

[0053]FIG. 9 is a block diagram of a TTCM encoder employing a tupleinterleaver.

[0054]FIG. 10 is a block diagram of a TTCM encoder employing a bitinterleaver.

[0055]FIG. 11A is a first portion of combination block diagram andgraphical illustration of a rate ⅔ TTCM encoder employing a STinterleaver, according to an embodiment of the invention.

[0056]FIG. 11B is a second portion of combination block diagram andgraphical illustration of a rate ⅔ TTCM encoder employing a STinterleaver, according to an embodiment of the invention.

[0057]FIG. 12 is a combination block diagram and graphical illustrationof rate ½ parallel concatenated encoder (PCE) employing a modulo-NInterleaver.

[0058]FIG. 13 is a graphical illustration of the functioning of amodulo-4 ST interleaver, according to an embodiment of the invention.

[0059]FIG. 14A is a graphical illustration of the generation ofinterleaver sequences from a seed interleaving sequence.

[0060]FIG. 14B is a graphical illustration of a process by whichmodulo-2 and modulo-3 interleaving sequences may be generated.

[0061]FIG. 14C is a graphical illustration of a process by which amodulo-4 interleaving sequence may be generated.

[0062]FIG. 15 is a graphical illustration of trellis encoding.

[0063]FIG. 16 is a graphical illustration of Turbo Trellis CodedModulation (TTCM) encoding.

[0064]FIG. 17 is a graphical illustration of a rate ⅔ TTCM encoderaccording to an embodiment of the invention.

[0065]FIG. 18A is a graphical illustration of a rate ½ TTCM encoder,with constituent ⅔ rate encoders, according to an embodiment of theinvention.

[0066]FIG. 18B is a graphical illustration of alternate configurationsof the rate ½ TTCM encoder illustrated in FIG. 18A.

[0067]FIG. 18C is a graphical illustration of alternate configurationsof the rate ½ TTCM encoder illustrated in FIG. 18A.

[0068]FIG. 18D is a graphical illustration of alternate configurationsof the rate ½ TTCM encoder illustrated in FIG. 18A.

[0069]FIG. 18E is a graphical illustration of alternate configurationsof the rate ½ TTCM encoder illustrated in FIG. 18A.

[0070]FIG. 19 is a graphical illustration of a rate ¾ TTCM encoder, withconstituent ⅔ rate encoders, according to an embodiment of theinvention.

[0071]FIG. 20A is a graphical illustration of a rate ⅚ TTCM encoder,with constituent ⅔ rate encoders, according to an embodiment of theinvention.

[0072]FIG. 20B is a graphical illustration which represents an alternateencoding that will yield the same coding rate as FIG. 20A.

[0073]FIG. 21A is a graphical illustration of a rate {fraction (8/9)}TTCM encoder, with constituent ⅔ rate encoders, according to anembodiment of the invention.

[0074]FIG. 21B is a graphical illustration which represents an alternateencoding that will yield the same coding rate as FIG. 21A

[0075]FIG. 22 is a graphical illustration of map 0 according to anembodiment of the invention.

[0076]FIG. 23 is a graphical illustration of map 1 according to anembodiment of the invention.

[0077]FIG. 24 is a graphical illustration of map 2 according to anembodiment of the invention.

[0078]FIG. 25 is a graphical illustration of map 3 according to anembodiment of the invention.

[0079]FIG. 26 is a block diagram of a modulo-2 (even/odd) TTCM decoderaccording to an embodiment of the invention.

[0080]FIG. 27 is a TTCM modulo-4 decoder according to an embodiment ofthe invention.

[0081]FIG. 28 is a graphical illustration of a modulo-N encoder/decodersystem according to an embodiment of the invention.

[0082]FIG. 29 is a graphical illustration of the output of the TTCMencoder illustrated in FIG. 17.

[0083]FIG. 30 is a graphical illustration of the tuple types produced bythe TTCM encoder illustrated in FIG. 18A.

[0084]FIG. 31 is a graphical illustration illustrating the tuple typesproduced by the rate ¾ encoders of FIG. 19.

[0085]FIG. 32 is a graphical illustration of the tuple types produced bythe rate ⅚ encoder illustrated in FIG. 20A.

[0086]FIG. 33 is a chart defining the types of outputs produced by the{fraction (8/9)}th encoder illustrated in FIG. 21A.

[0087]FIG. 34 is a further graphical illustration of a portion of thedecoder illustrated in FIG. 26.

[0088]FIG. 35 is a graphical illustration of the process carried onwithin the metric calculator of the decoder.

[0089]FIG. 36 is a graphical illustration of the calculation of aEuclidean squared distance metric.

[0090]FIG. 37 is a representation of a portion of a trellis diagram asmay be present in either SISO 2606 or SISO 2608.

[0091]FIG. 38 is a generalized illustration of a forward state metricalpha and a reverse state metric beta.

[0092]FIG. 39A is a block diagram folder illustrating the parallel SISOcoupling illustrated in FIG. 26.

[0093]FIG. 39B is a block diagram of a modulo-N type decoder.

[0094]FIG. 40 is a block diagram illustrating the workings of a SISOsuch as that illustrated at 3901, 3957, 2606 or 2701.

[0095]FIG. 41 is a graphical representation of the processing of alphavalues within a SISO such as illustrated at 3901, 4000 or 2606.

[0096]FIG. 42 is a graphical illustration of the alpha processing withinthe SISO 4000.

[0097]FIG. 43 is a block diagram further illustrating the read-writearchitecture of the decoder as illustrated in FIG. 2606.

[0098]FIG. 44 is a graphical illustration illustrating the generation ofdecoder sequences.

[0099]FIG. 45 is a graphical illustration of a decoder trellis accordingto an embodiment of the invention.

[0100]FIG. 46A is a graphical illustration of a method for applying theMin* operation to four different values.

[0101]FIG. 46B is a graphical illustration further illustrating the useof the Min* operation.

[0102]FIG. 47 is a graphical illustration of two methods of performingelectronic addition.

[0103]FIG. 48A is a block diagram in which a carry sum adder is added toa Min* circuit according to an embodiment of the invention.

[0104]FIG. 48B is a block diagram in which a carry sum adder is added toa Min* circuit according to an embodiment of the invention.

[0105]FIG. 49 is a graphical illustration of Min* calculation.

[0106]FIG. 50A is a graphical illustration of the computation of the logportion of the Min* operation assuming that Δ is positive, as well asnegative.

[0107]FIG. 50B is a graphical illustration of the computation of the logportion of the Min* operation, a variation of FIG. 50A assuming that Δis positive, as well as negative.

[0108]FIG. 51 is a graphical illustration of a Min* circuit according toan embodiment of the invention.

[0109]FIG. 51A is a graphical illustration of the table used by the logsaturation block of FIG. 51.

[0110]FIG. 51B is a graphical illustration of a simplified version ofthe table of FIG. 51A.

[0111]FIG. 52A is a graphical illustration and circuit diagramindicating a way in which alpha values within a SISO may be normalized.

[0112]FIG. 52B is a graphical illustration and circuit diagramindicating an alternate way in which alpha values within a SISO may benormalized.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

[0113]FIG. 1 is a graphic illustration of an environment in whichembodiments of the present invention may operate. The environmentillustrated at 101 is an information distribution system, such as may befound in a cable television distribution system.

[0114] In FIG. 1 data is provided to the system from an informationsource 103. For purposes of illustration, the information sourcedisplayed in FIG. 1 may be considered to be a cable television systemhead end which provides video data to end users. A formatter 105 acceptsdata from the information source 103. The data provided by informationsource 103 may comprise analog or digital signals such as (but notlimited to) video signals, audio signals, and data signals. Theformatter block 105 accepts the data from the information source andformats it into an appropriate form, such as message tuples, which areillustrated at 107. The formatted data is then provided to a channelencoder 109. Channel encoder 109 encodes that data provided to it. Insome embodiments of the present invention, the channel encoder 109 mayprovide an encoding, with different goals depending on the particularimplementation, for example to make the signal more robust, to reducethe error probability, to operate the system using less transmissionpower or to enable a more efficient decoding of the signal. Channelencoder 109 then provides the encoded data to a transmitter 111. Thetransmitter transmits the encoded data provided to it by the channelencoder 109, for example, using an antenna 113. The signal broadcastfrom antenna 113 is received by a relay satellite 115 and thenrebroadcast to a receiving terrestrial antenna, such as earth stationantenna 117. Earth station antenna 117 collects the satellite signal andprovides the collected signal to a receiver 119. The receiver 119 willamplify and demodulate/detect the signal as appropriate and provide thedetected signal to a decoder 121. Decoder 121 will essentially, reversethe process of the channel encoder 109 and recreate the message tuples123, which should represent a good estimate of the message tuples 107that had been broadcast. The decoder 121 may use Forward ErrorCorrection (FEC), in order to correct errors in the received signal. Thetuples 123 provided by the decoder are then provided to a formattingunit 125, which prepares the received message tuples for use by aninformation sink, such as the television display illustrated at 127.

[0115]FIG. 2 is a block diagram of a portion of a signal encoderaccording to an embodiment of the invention. In FIG. 2 message tuples107 are provided to channel encoder 109. Channel encoder 109 comprises aReed-Solomon unit 201, which provides a first encoding of the messagetuples 107. The output of the Reed-Solomon (RS) unit 201 which includesa RS encoder and may include an interleaver is then provided a turbotrellis-coded modulation (TTCM) encoder 208. The output of theReed-Solomon unit 201 is then provided to a turbo encoder 203, whichapplies a parallel concatenated (turbo) encoding to the input receivedfrom the Reed-Solomon unit 201, and further provides it to a mapper 205.In addition, some of the bits of the data output from the Reed-Solomonunit 201 may bypass the turbo encoder 203 entirely and be coupleddirectly into the mapper 205. Such data bits which bypasses the turboencoder 203 are commonly referred to as uncoded bits. The uncoded bitsare taken into account in the mapper 205 but are never actually encodedin the turbo encoder 203. In some embodiments of the invention there areno uncoded bits. In other embodiments of the invention there may beseveral uncoded bits depending on the data rate of the overall turbotrellis-coded modulation (TTCM) encoder desired. The output of theReed-Solomon unit 201 may vary in form depending on the overall ratedesired from the TTCM encoder 208. Turbo encoders, such as thatillustrated at 203, may have a variety of forms and classifications. Oneof the classifications of encoders in general and turbo encoders inparticular is illustrated in FIG. 3.

[0116]FIG. 3 is a block diagram of a parallel concatenated encoderillustrating the difference between systematic and nonsystematic forms.In FIG. 3 data is input into the circuit at 301. Data is output from theparallel concatenated encoder (PCE) circuit 300 at 303. The data output303 of the PCE illustrated at 300 may reach the output via threedifferent paths. Input data tuples (groups of one or more bits) may bereceived at 301 and coupled directly to the data output 303 throughselector mechanism 305 along the path labeled D. The data input may alsobe coupled into a first encoder 307 where it will be encoded and thencoupled along the path E₁ through selector 305 and into data output 303.The data accepted into the PCE circuit at 301 may also be provided to aninterleaver 309. Interleaver 309 rearranges the input sequence of thedata accepted by the PCE circuit at 301. In other words, the interleavershuffles the order of the data so that the data out of the interleaver309 is not the same order as the data into the interleaver 309. The dataout of the interleaver 309 is then provided to a second encoder 311. Thesecond encoder 311 encodes the data provided to it by the interleaver309 and then provides the encoded data along path E₂ through theselector 305 into the data output 303. If the selector 305 selects thedata from path D and E₁ and E₂, where D represents all of the input datatuple, then a systematic-type turbo encoding is performed. However, ifthe data selector selects only between path E₁ and E₂, such that thereis no direct path between the data input and data output, anonsystematic turbo encoding is performed. In general the data input at301 comprises input data tuples which are to be encoded. The data outputat 303 comprises code words, which are the encoded representation of theinput data tuples. In general, in a systematic type of encoding, theinput tuples are used as part of the output code words to which theycorrespond. Within parallel concatenated encoders, such as thatillustrated at 300, encoders such as the first encoder 307 and secondencoder 311 are commonly referred to as component or constituentencoders because they provide encoding, which are used as components ofthe overall turbo encoding. The first encoder 307 and the second encoder311 may also have a variety of forms and may be of a variety of types.For example, the first encoder 307 may be a block encoder or aconvolutional-type encoder. Additionally, the second encoder 311 mayalso be a block or convolutional-type encoder. The first and secondencoders themselves may also be of systematic or nonsystematic form. Thetypes of encoders may be mixed and matched so that, for example, thefirst encoder 307 may comprise a nonsystematic encoder and secondencoder 311 may comprise a systematic-type encoder.

[0117] Constituent encoders, such as first encoder 307 and secondencoder 311 may have delays incorporated within them. The delays withinthe encoders may be multiple clock period delays so that the data inputto the encoder is operated on for several encoder clock cycles beforethe corresponding encoding appears at the output of the encoder.

[0118] One of the forms of a constituent encoder is illustrated in FIG.4.

[0119]FIG. 4 is a schematic diagram of a rate two-thirds feed forwardnonsystematic convolutional encoder. The encoder illustrated at 400 inFIG. 4 is a rate two-thirds because there are two inputs 401 and 403 andthree outputs 405, 407 and 409. Accordingly, for each input tuplecomprising two input bits 401 and 403, which are accepted by the encoder400, the output is a code word having three bits 405, 407 and 409.Therefore, for each two bits input at inputs 401 and 403 three bits areoutput at 405, 407 and 409. The encoder of FIG. 4 comprises three delays417, 419 and 421. Such delays may be formed from D-type flip flops orany other suitable delay or storage element. The rate two-thirds feedforward encoder of FIG. 4 also comprises five modulo-2 adders 411, 413,415, 423 and 425. Modulo-2 adders are adders in which the outputs of themodulo-2 adder is equal to the modulo-2 sum of the inputs. Delayelements 417, 419 and 421 are clocked by an encoder clock. Modulo-2adders 411, 413, 415, 423 and 425 are combinational circuits which areunclocked. In combinational circuits the output appears a time delayafter the inputs are changed. This time delay is due to the propagationtime of the signal within the combinational circuits (this delay isassumed as a near zero delay herein) and not due to any clockingmechanisms. In contrast, a delay unit, such as 417, will not change itsoutput until it receives an appropriate clock signal. Therefore, for aninput signal to propagate, for example from input 403 through modulo-2adder 411, through delay 417, through modulo-2 adder 413, through delay419, through modulo-2 adder 415, through delay 421 in order to appear atoutput 409, the encoder clock 427 must first clock the input signal from403 through delay unit 417, then through delay unit 419, and finallythrough delay unit 421. Therefore, once an input signal appears at 403three encoder clocks 427 in succession will be required for theresultant output 409, which is associated with that input at 403, to beseen at the output.

[0120] The encoder of FIG. 4 is a feed forward encoder. The signal isalways fed forward and at no point in the circuit is there a path tofeed back a signal from an later stage to an earlier stage. As aconsequence a feed forward encoder, such as that illustrated in FIG. 4,is a finite impulse response (FIR) type of state machine. That is, foran impulse signal applied at the input, the output will eventuallysettle into a stable state.

[0121] The encoder illustrated in FIG. 4 may further be classified as anonsystematic encoder because none of the inputs, that is either 401 or403, appear at the output of the encoder. That is outputs 405, 407 or409 don't reproduce the inputs in an encoded output associated with thatinput. This can be inferred from the fact that output 407, 405 and 409have no direct connection to inputs 401 or 403.

[0122]FIG. 5 is a schematic diagram of a rate two-thirds, recursive,convolutional nonsystematic encoder. The encoder of FIG. 5 is similar tothe encoder of FIG. 4 in that both encoders are nonsystematic andconvolutional. The encoder of FIG. 5 is the same schematically as theencoder of FIG. 4 with the addition of a third input at modulo-2 adder511 and a third input at modulo-2 adder 515. The third input for each ofmodulo-2 adders 511 and 515 is formed by an additional modulo-2 adder527. Modulo-2 adder 527 is formed in part by the output of delay 521.Modulo-2 adder 527 receives an input from delay 521 which is provided tomodulo-2 adders 511 and 515. Accordingly the encoder of FIG. 5 isrecursive. In other words, the inputs of delays 517 and 521 arepartially formed from outputs occurring later in the signal path and fedback to an earlier stage in the circuit. Recursive encoders may exhibitoutputs that change when repeatedly clocked even when the inputs areheld constant. The encoder of FIG. 5 is a constituent encoder, and isused with an embodiment of the invention as will be described later.

[0123]FIG. 6 is a trellis diagram for the encoder illustrated in FIG. 5.A trellis diagram is a shorthand method of defining the behavior of afinite state machine such as the basic constituent encoder illustratedin FIG. 5. The state values in FIG. 6 represent the state of theencoder. As can be seen from the trellis diagram in FIG. 6, when theencoder of FIG. 5 is in any single state, it may transition to any oneof four different states. It may transition to four different statesbecause there are two inputs to the encoder of FIG. 5 resulting in fourdifferent possible input combinations which cause transitions. If therehad been only one input to the encoder of FIG. 5, for example, if inputs501 and 503 were connected, then each state in the trellis diagram wouldhave two possible transitions. As illustrated in the trellis diagram inFIG. 6, if the encoder is in state 0, state 1, state 2 or state 3, theencoder may then transition into state 0, state 2, state 4 or state 6.However, if the encoder is in state 4, state 5, state 6 or state 7, itmay transition into state 1, state 3, state 5 or state 7.

[0124]FIG. 7 is a block diagram of a turbo trellis-coded modulation(TTCM) encoder. In FIG. 7 an input data sequence 701 is provided to an“odd” convolutional encoder 703 and an interleaver 705. The interleaver705 interleaves the input data sequence 701 and then provides theresulting interleaved sequence to “even” convolutional encoder 707.Encoders 703 and 707 are termed “odd” and “even” respectively becauseencodings corresponding to odd input tuples (i.e. input tuple no. 1, 3,5, etc.) are selected by selector 709 from encoder 703 and encodingscorresponding to even input tuples (i.e. input tuple no. 0, 2, 4, etc.)are selected by selector 709 from encoder 707. The output of either theodd convolutional encoder 703 or the even convolutional encoder 707 isselected by a selecting mechanism 709 and then passed to a mapper 710.FIG. 7 is a generalized diagram according to an embodiment of theinvention which illustrates a general arrangement for a TTCM encoder.The odd convolutional encoder 703 receives the input data sequence and,in an embodiment of the invention, convolutionally, nonsystematically,encodes the input data sequence. Even convolutional encoder 707 receivesthe same input data as the odd convolutional encoder, except that theinterleaver 705 has rearranged the order of the data. The odd and evenconvolutional encoders may be the same encoders, different encoders oreven different types of encoders. For example, the odd convolutionalencoder may be a nonsystematic encoder, whereas the even convolutionalencoder may be a systematic encoder. In fact the convolutional encoders703 and 707 may be replaced by block-type encoders such as Hammingencoders or other block-type encoders well known in the art. For thepurposes of illustration, both constituent encoders 703 and 707 aredepicted as nonsystematic, convolutional, recursive encoders asillustrated in FIG. 5. The select mechanism 709 selects, fromconvolutional encoder 703, outputs corresponding to odd tuples of theinput data sequence 701. The select mechanism 709 selects, fromconvolutional encoder 707, outputs which correspond to even tuples ofthe input data sequence 701. Select mechanism 709 alternates inselecting symbols from the odd convolutional encoder 703 and the evenconvolutional encoder 707. The selector 709 provides the selectedsymbols to the mapper 710. The mapper 710 then maps the output of eitherthe even convolutional encoder 707 or the odd convolutional coder 703into a data constellation (not shown). In order to maintain a sequencemade up of distance segments stemming from the even and odd inputtuples, the selector 709 selects only encodings corresponding to eventuples of the input data sequence 701 from one encoder (e.g. 703), andselects only encoding corresponding to odd tuples of the input datasequence from the other encoder (e.g. 707). This can be accomplished bysynchronizing the selection of encoded tuples from the odd (703) andeven (707) encoders, for example using a clock 711, and by using anodd/even interleaver 705 to maintain an even/odd ordering of input datatuples to the even encoder 707. The odd/even interleaver 705 will bedescribed in detail later.

[0125] The encoder illustrated in FIG. 7 is a type which will be knownherein as a turbo trellis-coded modulation (TTCM) encoder. Theinterleaver 705, odd convolutional encoder 703, even convolutionalencoder 707 and selector form a turbo encoder, also known as a parallelconcatenated encoder (PCE). The encoder is known as a parallelconcatenated encoder because two codings are carried on in parallel. Forthe parallel encoding, in the FIG. 7 example one coding takes place inthe odd convolutional encoder 703, and the other takes place in the evenconvolutional encoder 707. An output is selected sequentially from eachencoder and the outputs are concatenated to form the output data stream.The mapper 710 shown in FIG. 7 provides the trellis coded modulation(TCM) function. Hence, the addition of the mapper makes the encoder aturbo trellis-type encoder. As shown in FIG. 7, the encoders may haveany number of bits in the input data tuple. It is the topology thatdefines the encoder-type.

[0126] The encoder of FIG. 7 is an illustration of only one of thepossible configurations that may form embodiments of the presentinvention. For example, more than one interleaver may be employed, asshown in FIG. 8.

[0127]FIG. 8A is a block diagram of a TTCM encoder using multipleinterleavers. FIG. 8A illustrates an exemplary embodiment of the presentinvention utilizing N interleavers.

[0128] The first interleaver 802 is called the null interleaver orinterleaver 1. Generally in embodiments of the invention the nullinterleaver will be as shown in FIG. 8A, that is a straight throughconnection, i.e. a null interleaver. All interleaving in a system willbe with respect to the null sequence produced by the null interleaver.In the case where the null interleaver is merely a straight throughconnection the null sequence out of the null interleaver will be thesame as the input sequence. The concept of null interleaver isintroduced as a matter of convenience, since embodiments of theinvention may or may not have a first interleaver a convenient way todistinguish is to say “where the first interleaver is the nullinterleaver” when the first encoder receives input tuples directly andto say “where the first interleaver is an ST interleaver”, when an STinterleaver occupies a position proximal to a first encoder.

[0129] In FIG. 8A source input tuples 801 are provided to encoder 811and to interleavers 802 through 809. There are N interleavers countingthe null interleaver as interleaver No. 1 and N encoders present in theillustration in FIG. 8A. Other embodiments may additionally add an STinterleaver as interleaver No. 1 to process input tuples 801 prior toproviding them to encoder 811.

[0130] Source tuples T₀, T₁ and T₂ are shown as three bit tuples forillustrative purposes. However, those skilled in the art will know thatembodiments of the invention can be realized with a varying number ofinput bits in the tuples provided to the encoders. The number of inputbits and rates of encoders 811 through 819 are implementation detailsand may be varied according to implementation needs without departingfrom scope and spirit of the invention.

[0131] Interleavers 803 through 809 in FIG. 8A each receive the samesource data symbols 801 and produce interleaved sequences 827 through833. Interleaved sequences 827 through 833 are further coupled intoencoders 813 through 819. Select mechanism 821 selects an encoded outputfrom encoders 811 through 819. Selector 821 selects from each encoder811 through 819 in sequence so that one encoded tuple is selected fromeach encoder in one of every N+1 selections. That is the selectionnumber 0 (encoded tuple t₀) is chosen from encoder 811, the selectionnumber 1 (encoded tuple u₁ is chosen from encoder 813 V₂ is chosen fromencoder 815, and so forth. The same selection sequence is then repeatedby selector 821.

[0132] In order not to miss any symbols, each interleaver is amodulo-type interleaver. To understand the meaning of the term modulointerleaver, one can consider the interleaver of FIG. 7 as a modulo-2interleaver. The interleaver of FIG. 7 is considered a modulo-2interleaver because input tuples provided to the interleaver during oddtimes (i.e. provided as input tuple 1, 3, 5 etc.) will be interleavedinto odd time positions at the output of the interleaver (e.g. outputtuple 77, 105, 321 etc.) That is the first tuple provided by an odd/eveninterleaver may be the third, fifth, seventh, etc. tuple provided fromthe interleaver, but not the second, fourth, sixth, etc. The result ofany modulo-2 operation will either be a 0 or a 1, that is even or oddrespectively, therefore the interleaver of FIG. 7 is termed a modulo-2or odd/even interleaver. In general, according to embodiments of theinvention, the value of N for a modulo-N interleaving system is equal tothe number of interleavers counting the Null interleaver as the firstinterleaver in the case where there is no actual first interleaver. Themodulo interleaving system of FIG. 8A is modulo-N because there are Ninterleaves, including null interleaver 1, interleaving system. Theinterleavers in a modulo interleaver system may interleave randomly, Srandomly, using a block interleaver, or using any other mechanism forinterleaving known in the art, with the additional restriction thatinput/output positional integrity be maintained. When a sequence oftuples is interleaved, the modulo position value of an output will bethe same as the modulo positional value of the input tuple. The positionof a tuple modulo-N is known as a sequence designation, modulodesignation, or modulo sequence designation. For example, in a modulo-4interleaver the first tuple provided to the interleaver occupiesposition 0 of the input tuple stream. Because 0 modulo-4 is zero themodulo sequence designation of the first input tuple is 0. The tupleoccupying the position 0 may then be interleaved to a new outputposition #4, #8, #12, #16, etc., which also have the same modulosequence designation, i.e. 0. The tuples occupying output position #4,#8, #12, #16 all have a sequence designation of 0 because 4 mod 4=8 mod4=12 mod 4=16 mod 4=0. Similarly, the input tuple occupying position 2and having sequence designation of 2 may be interleaved to a new outputposition #6, #10, #14, #20, etc, which also have the same modulosequence designation of 2. The tuples in output positions #6, #10, #14,#20 etc have a modulo sequence designation of 2 because 6 mod 4=10 mod4=14 mod 4=20 mod 4=2.

[0133] For example, in FIG. 7 the modulo-2 interleaver 705, also knownas an odd/even interleaver, may employ any type of interleaving schemedesired with the one caveat that the input data sequence is interleavedso that each odd sequence input to the interleaver is interleaved intoanother odd sequence at the output of the interleaver. Therefore,although interleaver 705 may be a random interleaver, it cannotinterleave the inputs randomly to any output. It can, however,interleave any odd input to any random odd output and interleave anyeven input into any random even interleaved output. In embodiments ofthe present invention, a modulo interleaving system, such as thatillustrated in FIG. 8A, the interleavers must maintain the modulopositional integrity of interleaved tuples. For example, if there are 5interleavers including the null interleaver (numbers 0-4) in FIG. 8A,then FIG. 8A would describe a modulo-5 interleaving system. In such asystem, the input source data would be categorized by a modulo sequencenumber equal to the sequence position of the source data tuple modulo-5.Therefore, every input data tuple would have a sequence value assignedto it between 0 and 4 (modulo-5). In each of the 5 interleavers of themodulo-5 system, source data elements (characterized using modulonumbers) could be interleaved in any fashion, as long as they wereinterleaved into an output data tuple having an output sequence modulonumber designation equal to the input sequence modulo numberdesignation. The terms modulo sequence number sequence designation,modulo position value modulo designation, modulo position all refer tothe same modulo ordering.

[0134] In other words an interleaver is a device that rearranges itemsin a sequence. The sequence is input in a certain order. An interleaverreceives the items form the input sequence, I, in the order I₀, I₁, I₂,etc., I₀ being the first item received, I₁ being the second itemreceived, item I₂ being the third item received. Performing a modulo-Noperation on the subscript of I yields, the modulo-N position value ofeach input item. For example, if N=2 modulo-N position I₀−Mod₂(0)=0 i.e.even, modulo-N position I₁=Mod₂(1)=1 i.e., odd, modulo-N positionI₂=Mod₂(2)=0 i.e. even.

[0135]FIG. 8B is a graphical illustration of examples of modulointerleaving. Interleaving is a process by which input data tuples aremapped to output data tuples.

[0136]FIG. 8B illustrates of the process of modulo interleaving. Aspreviously stated for the purposes of this disclosure an interleaver isdefined as a device having one input and one output that receives asequence of tuples and produces an output sequence having the same bitcomponents as the input sequence except for order. That is, if the inputsequence contains X bits having values of one, and Y bits having valuesof zero then the output sequence will also have X bits having values of1 and Y bits having values of zero. An interleaver may reorder the inputtuples or reorder the components of the input tuples or a combination ofboth. In embodiments of the invention the input and output tuples of aninterleaver are assigned a modulo sequence designation which is theresult of a modulo division of the input or output number of a tuple.That is, each input tuple is assigned a sequence identifier depending onthe order in which it is accepted by the interleaver, and each outputtuple is assigned a sequence identifier depending on the order in whichit appears at the output of the interleaver.

[0137] For example, in the case of a modulo-2 interleaver the sequencedesignation may be even and odd tuples as illustrated at 850 in FIG. 8B.In such an example, the input tuple in the 0 position, indicating thatit was the first tuple provided, is designated as an even tuple T₀.Tuple T₁, which is provided after tuple T₀ is designated as an oddtuple, tuple T₂, which is provided after T₁ is designated as an eventuple and so forth. The result of the modulo interleaving is illustratedat 852. The input tuples received in order T₀, T₁, T₂, T₃, T₅, T₆ havebeen reordered to T₂, T₃, T₆, T₅, T₀, T₁, T₄. Along with the reorderedtuples at 852 is the new designation I₀ through I₆ which illustrates themodulo sequence position of the interleaved tuples.

[0138] The modulo-2 type interleaver illustrated in FIG. 8B at 854 canbe any type of interleaver, for example, a block interleaver, a shuffleinterleaver or any other type of interleaver known in the art if itsatisfies the additional constraint that input tuples are interleaved topositions in the output sequence that have the modulo position value.Therefore an input tuple having an even modulo sequence designation willalways be interleaved to an output tuple having an even modulo sequencedesignation and never will be interleaved to an output tuple having anodd modulo sequence designation. A modulo-3 interleaver 856 willfunction similarly to a modulo-2 interleaver 854 except that the modulosequence designation will not be even and odd but zero, one and two. Thesequence designation is formed by taking the modulo-3 value of the inputposition (beginning with input position 0. Referring to FIG. 8B modulo-3interleaver 856 accepts input sequence T₀, T₁, T₂, T₃, T₄, T₅ and T₆(858) and interleaves it to interleaved sequence 860: T₃, T₄, T₅, T₆,T₁, T₂ which are also designated as interleaved tuples I₀ through I₆.

[0139] As a further illustration of modulo interleaving, a modulo-8interleaver is illustrated at 862. The modulo 8 interleaver at 862 takesan input sequence illustrated at 864 and produces an output sequenceillustrated at 866. The input sequence is given the modulo sequencedesignations of 0 through 7 which is the input tuple number modulo-8.Similarly, the interleaved sequence is given a modulo sequencedesignation equal to the interleaved tuple number modulo-8 and reorderedcompared to the input sequence under the constraint that the newposition of each output tuple has the same modulo-8 sequence designationvalue as its corresponding input tuple.

[0140] In summary, a modulo interleaver accepts a sequence of inputtuples which has a modulo sequence designation equal to the input tuplenumber modulo-N where N=H of the interleaver counting the nullinterleaver. The modulo interleaver then produces an interleavedsequence which also has a sequence designation equal to the interleavedtuple number divided by the modulo of the interleaver. In a modulointerleaver bits which start out in an input tuple with a certainsequence designation must end up in an interleaved modulo designation inembodiments of the present invention. Each of the N interleavers in amodulo N interleaving system would provide for the permuting of tuplesin a manner similar to the examples in FIG. 86; however, each(interleaver would yield a different permutation.

[0141] The input tuple of an interleaver, can have any number of bitsincluding a single bit. In the case where a single bit is designated asthe input tuple, the modulo interleaver may be called a bit interleaver.

[0142] Inputs to interleavers may also be arbitrarily divided intotuples. For example, if 4 bits are input to in interleaver at a timethen the 4 bits may be regarded as a single input tuple, two 2 bit inputtuples or four 1 bit input tuples. For the purposes of clarity of thepresent application if 4 bits are input into an interleaver the 4 bitsare generally considered to be a single input tuple of 4 bits. The 4bits however may also be considered to be ½ of an 8 bit input tuple, two2 bit input tuples or four 1 bit input tuples the principles describedherein. If all input bits input to the interleaver are kept together andinterleaved then the modulo interleaver is designated a tupleinterleaver (a.k.a. integral tuple interleaver) because the input bitsare interleaved as a single tuple. The input bits may be alsointerleaved as separate tuples. Additionally, a hybrid scheme may beimplimented in which the input tuples are interleaved as tuples to theirappropriate sequence positions, but additionally the bits of the inputtuples are interleaved separately. This hybrid scheme has beendesignated as an ST interleaver. In an ST interleaver, input tuples witha given modulo sequence designation are still interleaved to interleavedtuples of similar sequence designations. Additionally, however, theindividual bits of the input tuple may be separated and interleaved intodifferent interleaved tuples (the interleaved tuples must all have thesame modulo sequence designation as the input tuple from which theinterleaved tuple bits were obtained). The concepts of a tuple modulointerleaver, a bit modulo interleaver, and a bit-tuple modulointerleaver are illustrated in the following drawings.

[0143]FIG. 9 is a block diagram of TTCM encoder employing a tuple typeinterleaver. In FIG. 9 an exemplary input data sequence 901 comprises asequence of data tuples T₀, T₁, T₂, T₃ and T₄. The tuples are providedin an order such that T₀ is provided first, T₁ is provided second, etc.Interleaver 915 interleaves data sequence 901. The output of theinterleaver comprises a new data sequence of the same input tuples butin different order. The data sequence 903, after interleaving, comprisesthe data tuples T₄, T₃, T₀, T₁ and T₂ in that order. The tupleinterleaver illustrated in FIG. 9 at 915 is a modulo-2 or odd/even typeinterleaver. The original data sequence 901 is provided to oddconvolutional encoder 905 and the interleaved data sequence 903 isprovided to an even convolutional encoder 907. A select mechanism 909selects encoded outputs from the odd convolutional encoder 905 and theeven convolutional encoder 907, according to the procedure providedbelow and illustrated in FIG. 9, and provides the encoder outputselected to the mapper 911. The select mechanism 909 illustrativelychooses encoded outputs from the “odd” convolutional encoder 905 thatcorrespond to odd tuples in the input data sequence 901. The selectdevice 909 also chooses encoded tuples from the even convolutionalencoder 907, that correspond to the even tuples of input sequence 903.So if the odd convolutional encoder 905 produces encoded tuples O₀, O₁,O₂, O₃ and O₄ corresponding to the input sequence of data tuples 901,the selector will select O₁ and O₃ (which have an odd modulo sequencedesignation) to pass through the mapper. In like manner if the evenconvolutional encoder produces symbols E₄, E₃, E₀, E₁ and E₂ from theinput sequence 903 and select mechanism 909 selects E₄, E₀ and E₂ andpasses those encoded tuples to the mapper 911. The mapper will thenreceive a composite data stream corresponding to encoded outputs E₄, O₁,E₀, O₃, and E₂. In this manner an encoded version of each of the inputdata sequence tuples 901 is passed onto the mapper 911. Accordingly, allof the input data sequence tuples 901 are represented in encoded form inthe data 913 which is passed onto the mapper 911. Although both encodersencode every input tuple, the encoded tuples having an odd sequencedesignation are selected from encoder 905 and the encoded tuples havingan even sequence designation are selected from encoder 907. In theinterleaver 915 of FIG. 9, each tuple is maintained as an integral tupleand there is no dividing of the bits which form the tuple. A contrastingsituation is illustrated in FIG. 10.

[0144]FIG. 10 is a block diagram of a TTCM encoder employing a bit typeinterleaver. In FIG. 10 an input tuple is represented at 1003 as inputbits i₀ through i_(k−1). The input bits i₀ through i_(k−1) are coupledinto an upper constituent encoder of 1007. The input tuple 1003 is alsocoupled into interleaver 1005. The interleaver 1005 is further dividedinto interleavers 1009, 1011 and 1013. Each of the interleavers 1009,1011 and 1013 accepts a single bit of the input tuple. The input tuple1003 is then rearranged in the interleaver 1005 such that each bitoccupies a new position in the sequence that is coupled into the lowerconstituent encoder 1015. The interleaving performed by the interleaver1005 may be any type of suitable interleaving. For example, theinterleaver may be a block interleaver a modulo interleaver aspreviously described, or any other type of interleaver as known in theart.

[0145] In the illustrated interleaver of FIG. 10 the interleavingsequence provided by interleaver 1005, and hence by sub-interleavers1009, 1011 and 1013, is independent of the positions of the bits withinthe input 1003. Input tuple 1001 represents input bits which are notpassed through either of the constituent encoders 1007 or 1015. Theupper encoding 1017 comprises the uncoded input tuple 1001 plus theencoded version of input tuple 1003, which has been encoded in the upperconstituent encoder 1007. The lower encoding 1019 comprises the uncodedinput tuple 1001 plus the output of the lower constituent encoder 1015which accepts the interleaved version of input tuple 1003. A selector1021 accepts either the upper or lower encoding and passes selectedencoding to a symbol mapper 1023.

[0146]FIG. 11A is a first part of a combination block diagram andgraphic illustration of a rate ⅔ TTCM encoder employing a ST interleaveraccording to an embodiment of the invention. FIGS. 11A and 11B incombination illustrate a modulo-2 ST interleaver as may be used with arate ⅔ TTCM encoder. In FIG. 11A input tuples 1101 are provided to arate ⅔ encoder 1103. The rate ⅔ encoder 1103 is designated as an evenencoder because, although it will encode every input tuple, only thetuples corresponding to encoded even tuples will be selected fromencoder 1103 by the selection circuit. Input tuples comprise 2 bits, amost significant bit designated by an M designation and a leastsignificant bit designated by an L designation. The first tuple thatwill be accepted by the rate ⅔ even encoder 1103 will be the even tuple1105. The even input tuple 1105 comprises 2 bits where M₀ is the mostsignificant bit, and L₀ is the least significant bit. The second tupleto be accepted by the rate ⅔ even encoder 1103 is the 1107 tuple. The1107 tuple is designated as an odd tuple and comprises a mostsignificant bit M₁ and a least significant bit L₁. The input tuples aredesignated even and odd because the interleaver 1109, which is beingillustrated in FIG. 11A, is modulo-2 interleaver also known as aneven/odd interleaver. The same principles, however, apply to anymodulo-N interleaver. If the modulo interleaver had been a mod 3interleaver instead of a mod 2 interleaver then the input tuples wouldhave sequence designations 0, 1 and 2. If the modulo interleaver hadbeen a modulo-4 interleaver then the input tuples would have modulosequence designations 0, 1, 2, 3. The modulo interleaving scheme,discussed here with respect to modulo-2 interleavers and 2 bit tuples,may be used with any size of input tuple as well as any modulo-Ninterleaver. Additionally, any rate encoder 1103 and any type encodermay be used with the modulo ST interleaving scheme to be described. Arate ⅔ encoder, a modulo-2 ST interleaver, and 2 bit input tuples havebeen chosen for ease of illustration but are not intended to limitembodiments of the invention to the form disclosed. In other words, thefollowing modulo-2 ST interleaver is chosen along with 2 bit inputtuples and a rate ⅔ encoder system in order to provide for a relativelyuncluttered illustration of the principles involved. The ST interleaver1109 in this case actually can be conceptualized as two separate bittype interleavers 1111 and 1113. The separation of the interleavers isdone for conceptual type purposes in order to make the illustration ofthe concepts disclosed easier to follow. In an actual implementation theinterleaver 1109 may be implimented in a single circuit or multiplecircuits depending on the needs of that particular implementation.Interleaver 1111 accepts the least significant bits of the input tuplepairs 1101. Note input tuple pairs designate input tuples having a pair,i.e. MSB and LSB, of bits. The interleaver 1111 interleaves the leastsignificant bits of the input tuple pairs 1101 and provides aninterleaved sequence of least significant bits of the input tuple pairsfor example those illustrated in 1115. In the example, only eight inputtuple pairs are depicted for illustration purposes. In an actualimplementation the number of tuple pairs in a block to be interleavedcould number tens of thousands or even more. Eight input tuple pairs areused for ease of illustration purposes. The least significant bits ofthe input tuple pairs 1101 are accepted by the interleaver 1111 in theorder L₀, L₁, L₂, L₃, L₄, L₅, L₆, and L₇. The interleaver, in theexample of FIG. 11A, then provides an interleaved sequence 1115 in whichthe least significant bits of the input tuples have been arranged in theorder L₆, L₅, L₄, L₁, L₂, L₇, L₀ and L₃. Note that although the leastsignificant bit of the input tuple pairs have been shuffled by theinterleaver 1111 each least significant bit in an even tuple in theinput tuple pairs is interleaved to an even interleaved position in theoutput sequence 1115. In like manner, odd least significant bits in theinput sequence 1101 are interleaved by interleaver 1111 into oddposition in the output sequence 1115. This is also a characteristic ofmodulo ST interleaving. That is although the data input is interleaved,and the interleaving may be done by a variety of different interleavingschemes know in the art, the interleaving scheme, however, is modifiedsuch that even data elements are interleaved to even data elements andodd data elements are interleaved to odd data elements. In general, inmodulo-N interleavers the data input to an interleaver would beinterleaved to output positions having the same modulo sequencedesignation as the corresponding modulo sequence designation in theinput sequence. That is, in a modulo-4 interleaver an input data elementresiding in a input tuple with a modulo sequence designation of 3 wouldend up residing in an interleaved output sequence with a modulo sequencedesignation of 3. In other words, no matter what type of interleavingscheme the interleaver (such as 1111) uses, the modulo sequencedesignation of each bit of the input data tuples sequence is maintainedin the output sequence. That is, although the positions of the inputsequence tuples are changed the modulo interleaved positions aremaintained throughout the process. This modulo sequence designation,here even and odd because a modulo-2 interleaver is being illustrated,will be used by the selection mechanism to select encoded tuplescorresponding to the modulo sequence designation of the input tuples. Inother words, the modulo sequence designation is maintained both throughthe interleavers and through the encoders. Of course, since the inputtuples are encoded the encoded representation of the tuples appearing atthe output of the encoder may be completely different and may have morebits than the input tuples accepted by the encoder.

[0147] Similarly, the most significant bits of input tuples 1101 areinterleaved in interleaver 1113. In the example of FIG. 11A, thesequence M₀ through M₇ is interleaved into an output sequence M₂, M₇,M₀, M₅, M₆, M₃, M₄, and M₁. The interleaved sequence 1117, produced byinterleaving the most significant bits of the input tuples 1101 ininterleaver 1113, along with the interleaved sequence of leastsignificant bits 1115 is provided to into the “odd” rate ⅔ encoder 1119.Note that in both cases all data bits are interleaved into new positionswhich have the same modulo sequence designation as the correspondinginput tuples modulo sequence designation.

[0148]FIG. 11B is a second part of a combination block diagram andgraphic illustration of a rate ⅔ TTCM encoder employing an STinterleaver. In FIG. 11B the even rate ⅔ encoder 1103 and the odd rate ⅔encoder 1119, as well as the tuples input to the encoders, arereproduced for clarity. Even encoder 1103 accepts the input tuplesequence 1101. The odd encoder 1119 accepts an input sequence of tuples,which is formed from the interleaved sequence of most significant bits1117 combined with the interleaved sequence of least significant bits1115. Both encoders 1103 and 1119 are illustrated as rate ⅔nonsystematic convolutional encoders and therefore each have a 3 bitoutput. Encoder 1119 produces an output sequence 1153. Encoder 1103produces an output sequence 1151. Both sequences 1151 and 1153 are shownin script form in order to indicate that they are encoded sequences.Both rate ⅔ encoders accept 2 bit input tuples and produce 3 bit outputtuples. The encoded sequences of FIG. 11B may appear to have 2 bitelements, but in fact the two letter designation and comprise 3 encodedbits each. Therefore, output tuple 1155 which is part of sequence 1153is a 3 bit tuple. The 3 bit tuple 1155 however, is designated by ascript M₇ and a script L₅ indicating that that output tuple correspondsto an input tuple 1160, which is formed from most significant bit M₇ andleast significant bit L₅. In like manner, output tuple 1157 of sequence1151 comprises 3 bits. The designation of output tuple 1157 as M₀ and L₀indicates that that output tuple corresponds to the input tuple 1101,which is composed of input most significant bit M₀ and input leastsignificant bit L₀. It is worthwhile to note that output tuple ofencoder 1103, which corresponds to input tuple 1161 maintains the sameeven designation as input tuple 1161. In other words, the output tupleof an encoder in a modulo interleaving system maintains the same modulosequence designation as the input tuple to which it corresponds.Additionally, in a ST interleaver input tuple bits are interleavedindependently but are always interleaved to tuples having the samemodulo sequence designation.

[0149] Selector mechanism 1163 selects between sequences 1153 and 1151.Selector 1163 selects tuples corresponding to an even modulo sequencedesignation from the sequence 1151 and selects tuples corresponding toan odd modulo sequence designation from sequence 1153. The outputsequence created by such a selection process is shown at 1165. Thisoutput sequence is then coupled into mapper 1167. The modulo sequence1165 corresponds to encoded tuples with an even modulo sequencedesignation selected from sequence 1151 and encoded tuples with an oddmodulo sequence designation selected from 1153. The even tuples selectedare tuple M₀L₀, tuple M₂L₂, tuple M₄L₄ and tuple M₆L₆. Output sequencealso comprises output tuples corresponding to odd modulo sequencedesignation M₇M₅, tuple M₅L₁, tuple M₃L₇ and tuple M₁ and L₃

[0150] A feature of modulo tuple interleaving systems, as well as amodulo ST interleaving systems is that encoded versions of all the inputtuple bits appear in an output tuple stream. This is illustrated inoutput sequence 1165, which contains encoded versions of every bit ofevery tuple provided in the input tuple sequence 1101.

[0151] Those skilled in the art will realize that the scheme disclosedwith respect to FIGS. 11A and 11B can be easily extended to a number ofinterleavers as shown in FIG. 8A. In such a case, multiple modulointerleavers may be used. Such interleavers may be modulo tupleinterleavers in which the tuples that will be coupled to the encodersare interleaved as tuples or the interleavers may be ST interleaverswherein the input tuples are interleaved to the same modulo sequencedesignation in the output tuples but the bits are interleaved separatelyso that the output tuples of the interleavers will correspond todifferent bits than the input sequence. By interleaving tuples and bitswithin tuples a more effective interleaving may be obtained because bothbits and tuples are interleaved. Additionally, the system illustrated inFIGS. 11A and 11B comprise an encoder 1103 which accepts the sequence ofinput tuples 1101. The configuration of FIGS. 11A and 11B illustratesone embodiment. In a second embodiment the input tuples are STinterleaved before being provided to either encoder. In this way boththe even and odd encoders can receive tuples which have had theircomponent bits interleaved, thus forming an interleaving which may bemore effective. In such a manner, an even encoder may produce a codewhich also benefits from IT or ST tuple interleaving. Therefore, in asecond illustrative embodiment of the invention the input tuples aremodulo interleaved before being passed to either encoder. The modulointerleaving may be a tuple interleaving, or a ST interleaving.Additionally, the types of interleaving can be mixed and matched.

[0152] Additionally, the selection of even and odd encoders is arbitraryand although the even encoder is shown as receiving uninterleavedtuples, it would be equivalent to switch encoders and have the oddencoder receive uninterleaved tuples. Additionally, as previouslymentioned the tuples provided to both encoders may be interleaved.

[0153]FIG. 12 is a combination block diagram and graphical illustrationof a rate ½ parallel concatenated encoder (PCE) employing a modulo-Ninterleaver. FIG. 12 is provided for further illustration of the conceptof modulo interleaving. FIG. 12 is an illustration of a parallelconcatenated encoder with rate ½ constituent encoders 1207 and 1209. Theinput tuples to the encoder 1201 are provided to rate ½ encoder 1207.Each input tuple, for example, T₀, T₁, T₂ and T_(n) given an input tuplenumber corresponding to the order in which it is provided to the encoder1207 and interleaver 1211. The input tuple number corresponds to thesubscript of the input tuple. For example, T₀ the zero tuple is thefirst tuple provided to the rate ½ encoder 1207, T₁ is the second tupleprovided to the rate ½ encoder 1207, T₂ is the third tuple provided tothe rate ½ input encoder 1207 and T_(n) is the N plus first tupleprovided to the rate ½ encoder 1207. The input tuples may be a singlebit in which case the output of the rate ½ encoder 1207 would comprise 2bits. The input tuples may also comprise any number of input bitsdepending on the number of inputs to the rate ½ encoder 1207. The moduloconcept illustrated is identical where the rate ½ encoder is providedwith tuples having a single bit or multiple bits. The input tuples 1201are assigned a modulo sequence designation 1205. The modulo sequencedesignation is formed by taking the input tuple number modulo-N, whichis the modulo order of the interleaver. In the example illustrated, themodulo order of the interleaver 1211 is N. Because the modulo order ofthe interleaver is N the modulo sequence designation can be any integervalue between 0 and N−1. Therefore, the T₀ tuple has a modulo sequencedesignation of 0, the T₁ tuple has a modulo sequence designation of 1,the T_(n−1) input tuple has a modulo sequence designation of N−1, theT_(n) input tuple has a modulo sequence designation of 0 and the T_(n+1)input tuple has a modulo sequence designation of 1 and so forth.Interleaver 1211 produces interleaved tuples 1215. Similarly to theinput tuples the interleaved tuples are given a modulo sequencedesignation which is the same modulo order as the interleaver 1211.Therefore, if the input tuples have a modulo sequence designation from 0to N−1 then the interleaved tuples will have a modulo sequencedesignation of 0 to N−1. The interleaver 1211 can interleave accordingto a number of interleaving schemes known in the art. In order to be amodulo interleaver, however, each of the interleaving schemes must bemodified so that input tuples with a particular modulo sequencedesignation are interleaved to interleaved tuples with the same modulosequence designation. The interleaved tuples are then provided to asecond rate ½ encoder 1209. The encoder 1207 encodes the input tuples,the encoder 1209 encodes the interleaved tuples and selector 1219selects between the output of the encoder 1207 and the output of encoder1209. It should be obvious from the foregoing description that modulotype interleaving can be carried out using any modulo sequencedesignation up to the size of the interleaver. A modulo-2 interleaver istypically referred to herein as an odd/even interleaver as the modulosequence designation can have only the values of 1 or 0, i.e., odd oreven respectively.

[0154]FIG. 13 is a graphic illustration of the functioning of a modulo-4ST interleaver according to an embodiment of the invention. In theillustrated example, the modulo-4 ST interleaver 1301 interleaves ablock of 60 tuples. That is the interleaver can accommodate 60 inputtuples and perform and interleaving on them. Input tuples 24 through 35are illustrated at 1303, to demonstrate an exemplary interleaving.Interleaved tuples 0-59 are illustrated at 1305. Input tuples 24 through35 are illustrated at 1303 as 2 bit tuples. Input tuple 24 includes bitb₀₀ which is the LSB or least significant bit of input tuple 24 and b₀₁the MSB or most significant bit of input tuple 24. Similarly, inputtuple 25 includes b₀₂ which is the least significant bit (LSB) of tuple25 and b₀₃ which is the most significant bit of input tuple 25. Eachinput tuple 1303 is assigned a modulo sequence designation which isequal to the tuple number modulo-4. The modulo sequence designation oftuple 24 is 0, the modulo sequence designation of tuple 25 is 1, themodulo sequence designation of tuple 26 is 2, the modulo sequencedesignation of tuple 27 is 3, the modulo sequence designation of tuple28 is 0 and so forth. Because 1301 is a ST interleaver, the bits of eachtuple are interleaved separately. Although the bits of each tuple areinterleaved separately, they are interleaved into an interleaved tuplehaving the same modulo sequence designation, i.e. tuple number mod 4 inthe interleaved tuple as in the corresponding input tuple. Accordingly,bit b₀₀ the LSB of tuple 24 is interleaved to interleaved tuple number 4in the least significant bit position. b₀₁ the MSB of input tuple 24 isinterleaved to interleaved tuple 44 in the most significant bitposition. Note that the modulo sequence designation of input tuple 24 isa 0 and modulo sequence designation of interleaved tuple 4 andinterleaved tuple 44 are both 0. Accordingly, the criteria that bits ofan input tuple having a given modulo sequence designation areinterleaved to interleave positions having the same modulo sequencedesignation. Similarly, b₀₂ and b₀₃ of input tuple 25 are interleaved tointerleaved tuple 57 and interleaved tuple 37 respectively. B₀₄ and b₀₅of input tuple 26 are interleaved to interleaved tuples 2 and 22. Inlike manner the MSB and LSB of all illustrated input tuples 24 through35 are interleaved to corresponding interleaved tuples having the samemodulo sequence designation, as illustrated in FIG. 13.

[0155]FIG. 14A is a graphical illustration of a method for generating aninterleaving sequence from a seed interleaving sequence. Interleaversmay be implimented in random access memory (RAM). In order to interleavean input sequence, an interleaving sequence may be used. Becauseinterleavers can be quite large, it may be desirable that aninterleaving sequence occupy as little storage space within a system asfeasible. Therefore, it can be advantageous to generate largerinterleaving sequences from smaller, i.e. seed interleaving sequences.FIG. 14A is a portion of a graphical illustration in which a seedinterleaving sequence is used to generate four interleaving sequenceseach the size of the initial seed interleaving sequence. In order toillustrate the generation of sequences from the seed interleavingsequence, an interleaving matrix such as that 1401 may be employed. Theinterleaving matrix 1401 matches input positions with correspondingoutput positions. In the interleaving matrix 1401 the input positions I₀through I₅ are listed sequentially. I₀ is the first interleaving elementto enter the interleaving matrix 1401. I₁ is the second element, etc. Aswill be appreciated by those skilled in the art, the input elements I₀through I₅ may be considered to be individual bits or tuples. The inputpositions in the interleaving matrix 1401 are then matched with the seedsequence. By reading through the interleaving matrix 1401 an inputposition is matched with a corresponding output position. In theillustrative example, of the interleaving matrix 1401 input 10 ismatched with the number 3 of the seed sequence. This means that the I₀or first element into the interleaving matrix 1401 occupies position 3in the resulting first sequence. Similarly, I₁ will be matched with a 0position in sequence 1 and so forth. In other words, the input sequenceI₀, I₁, I₂, I₃, I₄, I₅ is reordered according to the seed sequence sothat the resulting sequence output from the interleaving matrix 1401 isI₁, I₂, I₅, I₀, I₄, I₃ where the output sequence is obtained by listingthe sequence of the output in the usual ascending order I₀, I₁, I₂, I₃,I₄, I₅, where the left most position is the earliest. Put another way,the resulting sequence number 1 is {3, 4, 0, 5, 2, 1}, which correspondsto the subscript of the output sequence 1409. Similarly, in interleavingmatrix 1403 also called the inverse interleaving matrix or INTLV⁻¹ theinput sequence 1400 is accepted by the interleaving matrix 1403 butinstead of being written into this interleaving matrix sequentially, asin the case with interleaving matrix 1401, the elements are written intothe interleaving matrix according to the seed sequence. The interleavingmatrix 1403 is known as the inverse of interleaving matrix 1401 becauseby applying interleaving matrix 1401 and then successively applyinginverse interleaving matrix 1403 to any input sequence, the originalsequence is recreated. In other words, the two columns of theinterleaving matrix 1401 are swapped in order to get interleaving matrix1403. Resulting output sequence 1411 is I₃, I₀, I₁, I₅, I₄, I₂.Therefore, sequence number 2 is equal to 2, 4, 5, 1, 0, 3.

[0156] The seed interleaving sequence can also be used to create anadditional two sequences. The interleaving matrix 1405 is similar tointerleaving matrix 1401 except that the time reversal of the seedsequence is used to map the corresponding output position. The outputthen of interleaver reverse (INTLVR 1405) is then I₄, I₃, I₀, I₅, I₁,I₂. Therefore, sequence 3 is equal to 2, 1, 5, 0, 3, 4.

[0157] Next an interleaving matrix 1407 which is similar to interleavingmatrix 1403 is used. Interleaving matrix 1407 has the same inputposition elements as interleaving matrix 1403, however, except that thetime reversal of the inverse of the seed sequence is used for thecorresponding output position within interleaving matrix 1407. In such amanner, the input sequence 1400 is reordered to I₂, I₄, I₅, I₁, I₀, I₃.Therefore, sequence number 4 is equal to 3, 0, 1, 5, 4, 2, which are, aspreviously, the subscripts of the outputs produced. Sequences 1 through4 have been generated from the seed interleaving sequence. In oneembodiment of the invention the seed interleaving sequence is an Srandom sequence as described by S. Dolinar and D. Divsalar in theirpaper “Weight Distributions for Turbo Codes Using Random and Non-RandomPermeations,” TDA progress report 42-121, JPL, August 1995.

[0158]FIG. 14B is a series of tables illustrating the construction ofvarious modulo interleaving sequences from sequence 1 through 4 (asillustrated in FIG. 14A). Table 1 illustrates the first step in creatingan interleaving sequence of modulo-2, that is an even/odd interleavingsequence, from sequence 1 and 2 as illustrated in FIG. 14A. Sequence 1is illustrated in row 1 of table 1. Sequence 2 is illustrated in row 2of table 1. Sequence 1 and sequence 2 are then combined in row 3 oftable 1 and are labeled sequence 1-2. In sequence 1-2 elements areselected alternatively, i.e. sequentially from sequence 1 and 2 in orderto create sequence 1-2. That is element 1, which is a 1, is selectedfrom sequence 1 and placed as element 1 in sequence 1-2. The firstelement in sequence 2, which is a 3, is next selected and placed as thesecond element in sequence 1-2. The next element of sequence 1-2 isselected from sequence 1, the next element is selected from sequence 2,etc. Once sequence 1-2 has been generated, the position of each elementin sequence 1-2 is labeled. The position of elements in sequence 1-2 islabeled in row 1 of table 2. The next step in generating theinterleaving sequence, which will be sequence 5 is to multiply each ofthe elements in sequence 1-2 by the modulo of the sequence beingcreated. In this case, we are creating a modulo-2 sequence andtherefore, each of the elements in sequence 1-2 will be multiplied by 2.If a modulo-3 sequence had been created in the multiplication step, theelements would be multiplied by 3 as will be seen later. Themultiplication step is a step in which the combined sequences aremultiplied by the modulo of the interleaving sequence desired to becreated.

[0159] This methodology can be extended to any modulo desired. Once thesequence 1-2 elements have been multiplied times 2, the values areplaced in row 3 of table 2. The next step is to add to each element, nowmultiplied by modulo-N (here N equals 2) the modulo-N of the position ofthe element within the multiplied sequence i.e. the modulo sequencedesignation. Therefore, in a modulo-2 sequence (such as displayed intable 2) in the 0th position the modulo-2 value of 0 (i.e. a value of 0)is added. To position 1 the modulo-2 value of 1 (i.e. a value of 1) isadded, to position 2 the modulo-2 value of 2 (i.e. a value of 0) isadded. To position 3 the modulo-2 value of 3 is (i.e. a value of 1) isadded. This process continues for every element in the sequence beingcreated. Modulo position number as illustrated in row 4 of table 2 isthen added to the modulo multiplied number as illustrated in row 3 oftable 2. The result is sequence 5 as illustrated in row five of table 2.Similarly, in table 3, sequence 3 and sequence 4 are interspersed inorder to create sequence 34. In row 1 of table 4, the position of eachelement in sequence 34 is listed. In row 3 of table 4 each element inthe sequence is multiplied by the modulo (in this case 2) of thesequence to be created. Then a modulo of the position number is added toeach multiplied element. The result is sequence 6 which is illustratedin row 5 of table 4.

[0160] It should be noted that each component sequence in the creationof any modulo interleaver will contain all the same elements as anyother component sequence in the creation of a modulo interleaver.Sequence 1 and 2 have the same elements as sequence 3 and 4. Only theorder of the elements in the sequence are changed. The order of elementsin the component sequence may be changed in any number of a variety ofways. Four sequences have been illustrated as being created through theuse of interleaving matrix and a seed sequence, through the use of theinverse interleaving of a seed sequence, through the use of a timedreversed interleaving of a seed sequence and through the use of aninverse of a time interleaved reverse of a seed sequence. The creationof component sequences are not limited to merely the methodsillustrated. Multiple other methods of creating randomized and Srandomized component sequences are known in the art. As long as thecomponent sequences have the same elements (which are translated intoaddresses of the interleaving sequence) modulo interleavers can becreated from them. The method here described is a method for creatingmodulo interleavers and not for evaluating the effectiveness of themodulo interleavers. Effectiveness of the modulo interleavers may bedependent on a variety of factors which may be measured in a variety ofways. The subject of the effectiveness of interleavers is one currentlyof much discussion in the art.

[0161] Table 5 is an illustration of the use of sequence 1, 2, and 3 inorder to create a modulo-3 interleaving sequence. In row 1 of table 5sequence 1 is listed. In row 2 of table 5 sequence 2 is listed and inrow 3 sequence 3 is listed. The elements of each of the three sequencesare then interspersed in row 4 of table 5 to create sequence 1-2-3.

[0162] In table 6 the positions of the elements in sequence 1-2-3 arelabeled from 0 to 17. Each value in sequence 1-2-3 is then multiplied by3, which is the modulo of the interleaving sequence to be created, andthe result is placed in row 3 of table 6. In row 4 of table 6 a modulo-3of each position is listed. The modulo-3 of each position listed willthen be added to the sequence in row 3 of table 3, which is the elementsof sequence 1-2-3 multiplied by the desired modulo, i.e. 3. Sequence 7is then the result of adding the sequence 1-2-3 multiplied by 3 andadding the modulo-3 of the position of each element in sequence 1-2-3.The resulting sequence 7 is illustrated in table 7 at row 5. As can beseen, sequence 7 is a sequence of elements in which the element in the 0position mod 3 is 0. The element in position 1 mod 3 is 1. The elementin position 2 mod 3 is 2. The element in position 3 mod 3 is 0 and soforth. This confirms the fact that sequence 7 is a modulo-3 interleavingsequence. Similarly, sequence 5 and 6 can be confirmed as modulo-2interleaving sequences by noting the fact that each element in sequence5 and sequence 6 is an alternating even and odd (i.e. modulo-2 equals 0or modulo-2 equals 1) element.

[0163]FIG. 14C is a graphical illustration of creating a modulo-4sequence from four component sequences. In table 7 sequences 1, 2, 3 and4 from FIG. 14A are listed. The elements of sequence 1, 2, 3 and 4 arethen interspersed to form sequence 1-2-3-4.

[0164] In table 8 row 1 the positions of each element in sequence1-2-3-4 are listed. In row 3 of table 8 each element of sequence 1-2-3-4is multiplied by a 4 as it is desired to create a modulo-4 interleavingsequence. Once the elements of sequence 1-2-3-4 have been multiplied by4 as illustrated in row 3 of table 8, each element has added to it amodulo-4 of the position number, i.e. the modulo sequence designation ofthat element within the 1-2-3-4 sequence. The multiplied value ofsequence 1-2-3-4 is then added to the modulo-4 of the position insequence 8 results. Sequence 8 is listed in row 5 of table 8. To verifythat the sequence 8 generated is a modulo-4 interleaving sequence eachnumber in the sequence can be divided mod 4. When each element insequence 6 is divided modulo-4 sequence of 0, 1, 2, 3, 0, 1, 2, 3, 0, 1,2, 3 etc. results. Thus, it is confirmed that sequence 8 is a modulo-4interleaving sequence, which can be used to take an input sequence oftuples and create a modulo interleaved sequence of tuples.

[0165]FIG. 15 is a general graphical illustration of trellis-codedmodulation (TCM). In FIG. 15, input tuples designated 1501 are coupledinto a trellis encoder 1503. Input tuples, for illustration purposes aredesignated T₀, T₁, T₂ and T₃. Within the trellis encoder 1503 the inputtuples 1501 are accepted by a convolutional encoder 1505. The inputtuples that have been convolutionally encoded are mapped in a mapper1507. The TCM process yields a signal constellation represented as a setof amplitude phase points (or vectors) on an In phase Quadrature (I-Q)plane. An example of such vectors illustrated at 1509, 1511, 1513, and1515. The vector represented in the I-Q (In phase and Quadrature)illustration is well known in the art. The process of convolutionallyencoding and mapping when taken together is generally referred to astrellis-coded modulation. A similar process called turbo trellis-codedmodulation (TTCM) is illustrated in FIG. 16.

[0166]FIG. 16 is a graphical illustration of TTCM (Turbo Trellis CodedModulation) encoding. In FIG. 16 input tuples 1601 are provided to aparallel concatenated (turbo) encoding module 1603. The parallelconcatenated turbo encoding module 1603 may comprise a number ofencoders and interleavers. Alternatively, the parallel concatenatedencoder 1603 may comprise a minimum of two encoders and one interleaver.The output of the turbo encoder is then provided to an output selectionand puncturing module. In module 1605 outputs are selected from theconstituent encoders of the module 1603. The selection of outputs of thedifferent encoders is sometimes termed puncturing by various sources inthe art, because some of the code bits (or parity bits) may beeliminated). Selection of outputs of the constituent encoders within thepresent disclosure will be referred to herein as selecting. The termselecting is used because, in embodiments of the present invention,encoded tuples are selected from different encoders, but encoded tuplescorresponding to each of the input tuples are represented. For example,there may be an encoder designated the odd encoder from which tuplescorresponding to encoded versions of odd input tuples are selected. Theother encoder may be termed an even encoder in which the coded versionsof the even tuples are selected. This process is termed selectingbecause even though alternating encoded tuples are selected fromdifferent encoders a coded version of each input is represented. Thatis, in the selection process though some encoded symbols are discardedfrom one encoder and some encoded symbols are discarded from otherconstituent encoder(s) the selection and modulo interleaving process issuch that encoded versions of all input elements are represented. Bymodulo encoding and selecting sequentially from all encoders, encodedversions of all input bits are represented. The term puncturing as usedherein will be used to describe discarding parts or all of encodedtuples which have already been selected. The selected tuples areprovided to a mapping 1607. In embodiments of the present invention themapping may be dependent on the source of the tuple being mapped. Thatis, the mapping may be changed for example depending on whether thetuple being mapped has been encoded or not. For example, a tuple fromone of the encoders may be mapped in a first mapping. An uncoded tuplewhich has bypassed the encoder however may be mapped in a secondmapping. Combination tuples in which part of the tuple is encoded andpart of it is uncoded may also have different mappings. A combination of3 blocks—block 1603, parallel concatenated encoding, block 1605, outputselection and puncturing, and block 1607 mapping comprise what is knownas the turbo trellis-coded modulation (TTCM) encoder 1609. The output ofthe TTCM encoder is a series of constellation vectors as illustrated byexamples at 1611, 1613, 1615 and 1617.

[0167]FIG. 17 is a graphical illustration of a rate ⅔ encoder accordingto an embodiment of the invention. In FIG. 17, input tuples T₀ and T₁represented at 1701 are provided to odd encoder 1703. Tuple T₀ comprisesbits, b₀ and b₁ tuple T₁ comprises bits b₂ and b₃. The input tuples T₀and T₁ are also provided to an interleaver 1705. Interleaver 1705accepts input tuples (such as T₀ and T₁) and after interleaving,provides the interleaved tuples to the even encoder 1709. When oddencoder 1703 is accepting tuple T₀, comprising bits b₀ and b₁, evenencoder 1709 is accepting an interleaved tuple comprising bits i₀, andi₁. Similarly, when odd encoder 1703 is accepting tuple T₁ comprisingbits b₂ and b₃ even encoder 1709 is accepting an interleaved tuplecomprising bits i₂ and i₃. At each encoder clock (EC) both encodersaccept an input tuple. The interleaver 1703 is a modulo-2 (even/odd) STinterleaver. Each encoder accepts every input tuple. The even/odddesignation refers to which encoded tuple is selected to be accepted bythe mapper 1715. By maintaining an even/odd interleaving sequence and byselecting encoded tuples alternatively from one then the other encoder,it can be assured that an encoded version of every input tuple isselected and passed on to the mapper 1715. For example, the encodedtuple 1711, comprising bits c₃ and c₄, and c₅ and corresponding to tupleT₁ is selected and passed onto mapper 1715, which maps both even and oddselections according to map 0.

[0168] The encoded tuple c₀, c₁ and c₂, corresponding to input tuple T₀is not selected from the odd encoder 1703. Instead, the tuple comprisingbits c′₀, c′₁, and c′₀, which corresponds to the interleaved input i₀and i₁ is selected and passed on to mapper 1715, where it is mappedusing map 0.

[0169] Accordingly, all the components of each tuple are encoded in theodd encoder and all components of each tuple are also encoded in theeven encoder. However, only encoded tuples corresponding to input tupleshaving an odd modulo sequence designation are selected from odd encoder1703 and passed to the mapper 1715. Similarly only encoded tuplescorresponding to input tuples having an even modulo sequence designationare selected from even encoder 1709 and passed to mapper 1703.Therefore, the odd and even designation of the encoders designate whichtuples are selected from that encoder for the purposes of being mapped.

[0170] Both encoder 1703 and 1709 in the present example of FIG. 17 areconvolutional, nonsystematic, recursive encoders according to FIG. 5.Although only encoded versions of odd tuples are selected from encoder1703, and only encoded versions of even tuples are selected from encoder1709, because both encoders have memory, each encoded output tuple notonly contains information from the tuple encoded, but also from previoustuples.

[0171] The even/odd encoder of FIG. 17 could be modified by includingmodulo-N interleaving, modulo-N interleaving could be accomplished byadding the appropriate number of both interleavers and encoders, to forma modulo-N TTCM encoder. Additionally, other configurations may bepossible. For example, interleaver 1705 may be a ST interleaver. As analternate another interleaver may be added prior to odd encoder 1703.For example, if a bit interleaver, to separate the input tuple bits wereadded prior to encoder 1703, and interleaver 1705 were an ITinterleaver, the overall effect would be similar to specifyinginterleaver 1705 to be an ST interleaver.

[0172] Both encoders 1703 and 1709 are rate ⅔ encoders. They are bothnonsystematic convolutional recursive encoders but are not be limited tosuch.

[0173] The overall TTCM encoder is a ⅔ encoder because both the oddencoder 1703 and the even encoder 1709 accept an input tuple comprising2 bits and output an encoded output tuple comprising 3 bits. So eventhough the output to mapper 0 switches between even and odd encoders,both encoders are rate ⅔ and the overall rate of the TTCM encoder ofFIG. 17 remains at ⅔.

[0174]FIG. 18 is a graphical illustration of a rate ½ TTCM encoderimplimented using the constituent rate ⅔ base encoders, according to anembodiment of the invention. In FIG. 18, exemplary input tuples T₀ andT₁ are provided to the TTCM encoder 1800. The T₀ tuple comprises asingle bit b₀ and the T₁ tuple comprises a single bit b₁. b₀ and b₁corresponding to tuples T₀ and T₁ are provided to odd encoder 1803. Bothb₀ and b₁ are also provided to interleaver 1805. At the time when oddencoder 1803 is accepting b₀ even encoder is accepting i₀. i₀ is anoutput of the interleaver 1805. Similarly, i₁ is a output of interleaver1805 that is provided to even encoder 1809 at the same time that bit b₁is provided to odd encoder 1803. The interleaver 1805 is an odd/eveninterleaver (modulo-2). In such a manner when an odd tuple is beingprovided to odd encoder 1803, an interleaver odd tuple is being providedto even encoder 1809. When an even tuple is being provided to odd 1803,an even interleaved tuple is being provided to even encoder 1809. Inorder to achieve a rate ½ code from rate ⅔ constituent encoders, inaddition to an input comprising a single input bit, a constant bit valueprovided to 1811 is a second input of each of the constituent rate ⅔encoders 1803 and 1809. In FIG. 18A the input bit is shown as being a 0but could just as easily be set to a constant value of 1. Additionally,each encoder input bit might be inputted twice to the odd encoder 1803and the even encoder 1809 as illustrated in FIG. 18B. Multiple otherconfigurations are possible. For example both encoders might receiveboth input tuples as illustrated in FIG. 18C, or one of the inputs mightbe inverted as in FIG. 18E. Additionally hybrid combinations, such asillustrated in FIG. 18D are possible.

[0175] The output of odd encoder 1803, which corresponds to input tupleTo comprises bits c₀, c₁, c₂. The output tuple of odd encoder 1803corresponding to tuple T₁ comprises bits c₃, c₄, and c₅. At encoderclock EC₀ the even encoder 1809 has produced an encoded output tuplehaving bits c′₀, c′₁ and c′₂. One of the three encoded bits, in thepresent illustration c′₂, is punctured i.e. dropped and the remaining 2bits are then passed through to mapper 1813. During the odd encoderclock OC₁ two of three of the encoded bits provided by odd encoder 1803are selected and passed to mapper 1813. Output bit c₄ is illustrated aspunctured, that is being dropped and not being passed through the outputmapper 1813. Mapper 1813 employs map number 3 illustrated further inFIG. 24. For each encoder clock a single input tuple comprising 1 bit isaccepted into the TTCM encoder 1800. For each clock a 2-bit encodedquantity is accepted by mapper 1813. Because for each one bit providedto the encoder, 2 bits are outputted, therefore the encoder is a rate ½encoder. The odd and even encoders in the present embodiment arenonsystematic, convolutional, recursive encoders, but are not limited tosuch. The encoders may be any combination, for example such assystematic, block encoders. Interleaver 1805 is an odd/even interleaverand so odd output tuples are accepted by the mapper 1813 from oddencoder 1803 and even encoded tuples are accepted by the mapper 1813from even encoder 1809. In such a manner, all input tuples arerepresented in the output accepted by mapper 1813, even though some ofthe redundancy is punctured. Mapper 1813 utilizes map 3 as illustratedin FIG. 25 for use by rate ½ TTCM encoder 1800.

[0176]FIG. 19 is a graphical illustration of a rate ¾ TTCM encoder,having constituent ⅔ rate encoders, according to an embodiment of theinvention. In FIG. 19 the input tuples T₀ and T₁, illustrated at 1901,comprise 3 bit input tuples. Input tuple T₀ comprises bits b₀, b₁ andb₂. Input tuple T₁ comprises bits b₃, b₄ and b₅. Bit b ₂ of input tupleT₀ is underlined as is b ₅ of input tuple T₁. Bits b ₂ and b ₅ areunderlined because neither of these bits will pass through eitherencoder. Instead, these bits will be concatenated to the output of theeven or odd encoder and the resulting in a 4 bit tuple provided tomapper 1911. b₀ and b₁ of input tuple T₀ are provided to odd encoder1903. At the same time that b₀ and b₁ are being accepted by the oddencoder 1903, interleaved bits i₀ and i₁ are being accepted by evenencoder 1909. Interleaver 1905 is an odd/even (module-2) typeinterleaver. The encoders illustrated at 1903 and 1909 are the encodersillustrated in FIG. 5. Encoders 1903 and 1909 are the same as theencoders illustrated at 1803 and 1809 in FIG. 18, 1703 and 1709 in FIG.17 and as will be illustrated at 2003 and 2009 in FIG. 20A and 2103 and2109 in FIG. 21A In other words, the odd encoder and even encoder arerate ⅔, nonsystematic, convolutional recursive encoders. Other types ofencoders may however be used, and types may be mixed and matched asdesired.

[0177]FIGS. 17 through 21 are encoding arrangements that utilize thesame basic encoder as illustrated in FIG. 5. In FIG. 19, encoders 1903and 1909 are illustrated as separate encoders for conceptual purposes.Those skilled in the art will realize that a single encoder may be usedand may be time-shared. FIGS. 17 through 21 are conceptual type Figuresand are figures that represent general concepts. They depict the generalconcept accurately regardless of the particular implementation ofcircuitry chosen. In the rate ¾ encoder of FIG. 19, the input tuples T₀,T₁ (and all other input tuples to the encoder of FIG. 19) comprise 3bits. Since encoders 1903 and 1909 are rate ⅔ encoders with 2 inputbits, then only 2 bits can be accommodated at a particular time.Accordingly, bit b ₂ of tuple T₀ and bit b ₅ of tuples T₁ bypass theencoders completely. b ₅ is concatenated to the output of odd encoder1903, i.e. c₃, c₄ and c₅ the combination of encoder tuple c₃, c₄, c₅ andb ₅ are then provided to mapper 1911 which maps the output according tomap 2. Map 2 is illustrated in FIG. 24. Similarly, the output of evenencoder 1909, comprising encoded bits c′₀, c′₁ and c′₂, is combined withbit b ₂ of input tuple T₀ and then the combination of b ₂, c′₀, c′₁, c′₂is provided to mapper 1911. In such a way the three bits of encodedtuples are converted into four bits for mapping in mapper 1911. The fourbits mapped comprise the three encoded bits from either the odd or evenencoder plus a bit from the input tuple which has by passed bothencoders.

[0178]FIG. 20A is a graphical illustration of a rate ⅚ TTCM encoder,having constituent ⅔ rate basic encoders, according to an embodiment ofthe invention. In FIG. 20A the input tuples T₀ and T₁ are illustrated at2001. Input tuple T₀ comprises five bits, b₀ through b₄. Input tuple T₁also comprises five bits, b₅ through b₉. b ₄ of tuple T₀ and b ₉ oftuple T₁ are underlined to illustrate that they do not pass througheither encoder. The odd encoder 2003 accepts b₀ and b₁ during a firstencoder clock time during which even encoder 2009 is acceptinginterleaved bits i₀ and i₁. Bits i₀ and i₁ are the outputs of theinterleaver 2005 that correspond to the same time during which inputs b₀and b₁ are accepted from the odd encoder. Similarly, the odd encoder2003 is accepting bits b₂ and b₃ at a time when the even encoder 2009 isaccepting bits i₂ and i₃. Similarly, input tuple T₁, is separated into 2bit encoder input tuples because the constituent encoders are rate ⅔encoders which accept 2 bits input and produce three encoded bits out.Because each input tuple 2001 is five bits and because each encoderallows only a 2 bit input, input tuple T₀ is separated into encodertuple b₀ and b₁ and encoder tuple b₂ and b₃. The encoder therefore, mustprocess two encoder input tuples for each input tuple 2001. Therefore, asingle input tuple 2001 will require two encoder clocks for processing.The even encoder 2009 encodes tuple i₀ and i₁ and produces correspondingoutput code bits c′₀, c′₁ and c′₂. After processing i₀ and i₁ the evenencoder 2009 processes i₂ and i₃ The output of even encoder 2009, whichcorresponds to input bits i₂ and i₃ is c′₃, c′₄ and c′₅. The odd encoder2003 processes a first tuple b₀ and b₁ and then processes a second tupleb₂ and b₃. Tuple b₀ and b₁ are accepted by encoder 2003 which produces acorresponding encoded 3 bit tuple c₀, c₁ and c₂. After accepting b₀ andb₁, the odd encoder 2003 accepts second tuple b₂ and b₃ and produces acorresponding output c₃, c₄, and c₅. Encoder output c′₀, c′₁, and c′₂corresponding to encoder tuple i₁ and i₀ are provided to mapper 2011.Mapper 2011 uses map 0 to map c′₀, c′₁ and c′₂. Subsequently toproducing c′₀, c′₁ and c′₂ even encoder 2009 accepts i₂ and i₃ andproduces output c₃, c₄, and c₅. Instead of selecting c₃, c₄, c₅ to bemapped, uncoded bit b ₄ is combined with interleaved bits i₂ and i₃ andselected. i₂, i₃ and b ₄ are then accepted by mapper 2011, which employsmap 1 to map bits i₂, i₃ and b ₄. Therefore, with respect to the overallinput tuple T₀ five bits are input into the TTCM encoder 2000 and sixbits are passed to mapper 2011. In other words, a coding rate of ⅚ isgenerated. Similarly, odd encoder 2003 encodes bits b₅ and b₆ andproduces coded bits c₆, c₇ and c₈. Subsequently odd encoder 2003 encodesbits b₇ and b₈ and produces coded bits c₉, c₁₀ and c₁₁. c₆, c₇ and c₈are passed to the encoder 2001 as is where they are mapped using map 0.Encoded bit c₉, c₁₀ and c₁₁, however, are punctured, i.e. they aredropped and instead bits b₇, b₈ and b ₉ are substituted. b₇, b₈ and b ₉are passed to encoder 2011 which uses map 1 to map b₇, b₈, and b ₉. Agraphical illustration of map 0 can be found in FIG. 22 and a graphicalillustration of Map 1 can be found in FIG. 23. In the manner justdescribed, a rate ⅚ TTCM encoder is realized from two component rate ⅔encoders. Interleaver 2005 is similar to interleaver 1705, 1805, 1905,2005 and 2105 which also are even/odd or modulo-2 type interleavers.Other modulo interleavers, just as with all other embodimentsillustrated in FIGS. 17 through 21, can be realized by adding additionalinterleavers and encoders and by selecting outputs and uncoded bits in astraight format manner similar to that illustrated in FIG. 20A.

[0179]FIG. 20B represents an alternate encoding that will yield the samecoding rate as FIG. 20A.

[0180]FIG. 21A is a graphical illustration of a rate {fraction (8/9)}TTCM encoder realized using constituent rate ⅔ encoder, according to anembodiment of the invention. To illustrate the functioning of TTCM rate{fraction (8/9)} encoder 2100 two sequential input tuples T₀ and T₁,illustrated at 2101, will be considered. Since the constituent encodersare rate ⅔ having two bits as input and three bits as output, the inputtuples will have to be subdivided into encoder tuples. In other words,the input tuples will be divided into tuple pairs which can be acceptedby odd encoder 2103 and even encoder 2109. Odd encoder 2103 acceptstuple pair b₀ and b₁, pair b₂ and b₃, pair b₄ and b₅, pair b₈ and b₉,pair b₁₀ and b₁₁, and pair b₁₂ and b₁₃ sequentially, since the basic ⅔rate encoder can only accept one pair of input bits at a time. Evenencoder correspondingly accepts input pairs i₀ and i₁, input pair i₂ andi₃, input pair i₄ and i₅, input pair i₈ and i₉, input pair i₁₀ and i₁₁,and input pair i₁₂ and i₁₃ sequentially. The pairs accepted by the evenencoder correspond to tuple pairs having the same numbering accepted bythe odd encoder at the same time. That is i₀ and i₁ are accepted by theeven encoder 2109 during the same time period as input pair b₀ and b₁ isaccepted by the odd encoder 2103. Odd and even encoders then produceencoded outputs from the input pairs accepted. Even encoder 2909produces a first encoded output triplet c′₀, c′₁ and c′₂ followed by asecond output triplet c′₃, c′₄ and c′₅ followed by a third outputtriplet c′₆, c′₇ and c′₈ (a triplet is a 3 bit tuple). The first outputtriplet c′₀, c′₁, and c′₂ is accepted by the mapper 2111. The mapper2111 utilizes map 0 to map encoded output c′₀, c′₁, and c′₂. Encodedoutput bits c′₃, c′₄ and c′₅ however are punctured, that is not sent tothe mapper. Instead of sending c′₃, c′₄ and c′₅ to the mapper 2111 thetriplet of bits comprising i₂, i₃ and b ₆ are sent to the mapper 2111.The mapper 2111 utilizes map 1 as the mapping for the triplet i₂, i₃, b₆. Encoded triplet c′₆, c′₇ and c′₈ is also punctured. That is, it isnot sent to the mapper 2111. Instead, i₄, i₅ and b ₇ is sent to themapper 2111 which uses map 1 to map input triplet i₄, i₅ and b ₇.Because eight bits corresponding to tuple T₀ are accepted by the evenencoder 2109 and nine bits are output into the mapper 2111 the overallencoder 2100 is a rate {fraction (8/9)} encoder. Similarly, input tupleT₁ is encoded by the odd encoder 2103. The output triplet from the oddencoder c₉, c₁₀ and c₁₁ corresponds to input tuple b₈ and b₉. Next, oddencoder 2103 produces an encoded output triplet c₁₂, c₁₃ and c₁₄, whichis an output triplet corresponding to input pair b₁₀ and b₁₁.Subsequently odd encoder 2103 produces output triplet c₁₅, c₁₆ and c₁₇.Output triplet c₁₅, c₁₆ and c₁₇ corresponds to input pair b₁₂ and b₁₃.Output triplet c₉, c₁₀ and c₁₁ are sent to the mapper 2111 which usesmap 0 to map output triplet c₉, c₁₀ and c₁₁. Output triplet c₁₂, c₁₃ andc₁₄ however is punctured and in its place b₁₀, b₁₁, and b ₁₄ is sent tomapper 2111 where map 1 is employed to map the input triplet b₁₀, b₁₁and b ₁₄. The encoder triplet c₁₅, c₁₆ and c₁₇ is also punctured and atriplet comprising b₁₂, b₁₃ and b ₁₅ is provided to mapper 2111. Map 1is used to map the input triplet b₁₂b₁₃ and b ₁₅. In the manner justdescribed an {fraction (8/9)} encoder is fabricated from two constituentrate ⅔ encoder.

[0181] From the foregoing TTCM encoder examples of FIGS. 17 through 21it is seen that the basic rate ⅔ encoders can be used in a variety ofconfigurations to produce a variety of coding rates.

[0182] The basic constituent encoders illustrated in FIGS. 17 through 21are rate ⅔, nonsystematic, convolutional recursive encoders. Theseillustrations represent a few examples. Different types of encoders andeven different rates of encoders may yield many other similar examples.Additionally, encoder types can be mixed and matched; for example, arecursive nonsystematic convolution encoder may be used with anonrecursive systematic block encoder.

[0183] Additionally, the interleavers illustrated in FIGS. 17 through 21are modulo-2 (even/odd) ST interleavers. Those skilled in the art willrealize that IT type interleavers may be used alternatively in theembodiments of the invention illustrated in FIGS. 17 through 21.

[0184] Additionally the TTCM encoders illustrated in FIGS. 17 through 21may employ modulo-N encoding systems instead of the modulo-2 (even/odd)encoding systems illustrated. For example, each of the constituentencoder—modulo-2 interleaver subsystems may be replaced by modulo-Nsubsystems such as illustrated in FIG. 8A. By maintaining the same typepuncturing and selecting with each encoder as displayed with theeven/odd encoders of FIGS. 17 through 21 and extending it to modulo-Nsystems, such as illustrated in FIG. 8A, the same coding rates can bemaintained in a modulo-N system for any desired value N.

[0185]FIG. 21B represents an alternate encoding that will yield the samecoding rate as FIG. 21A

[0186]FIG. 22 is a graphical illustration of map 0 according to anembodiment of the invention. Map 0 is used in the implementation of therate ⅔ encoder as illustrated in FIG. 17. Map 0 is also utilized in rate⅚ encoder illustrating in FIG. 20A and rate {fraction (8/9)} encoderillustrated in FIG. 21A.

[0187]FIG. 23 is a graphical illustration of map 1 according to anembodiment of the invention. Map 1 is used by the mapper in the rate ⅚encoder in FIG. 20A, and in the mapper in the rate {fraction (8/9)}encoder in FIG. 21A.

[0188]FIG. 24 is a graphical illustration of map 2 according to anembodiment of the invention. Map 2 is utilized in the fabrication of therate ¾ encoder as illustrated in FIG. 19.

[0189]FIG. 25 is a graphical illustration of map 3 according to anembodiment of the invention. Map 3 is used in the rate ½ encoder asdepicted in FIG. 18.

[0190] Maps 0 through 3 are chosen through a process different from thetraditional approach of performing an Ungerboeck mapping (as given inthe classic work “Channel Coding with Multilevel/Phase Signals” byGottfried Ungerboeck, IEEE Transactions on Information Theory Vol. 28No. 1 January 1982). In contrast in embodiments of the presentinvention, the approach used to develop the mappings was to select nonUngerboeck mappings, then to measure the distance between the code wordsof the mapping. Mappings with the greatest average effective distanceare selected. Finally the mappings with the greatest average effectivedistance are simulated and those with the best performance are selected.Average effective distance is as described by S. Dolinar and D. Divsalarin their paper “Weight Distributions for Turbo Codes Using Random andNon-Random Permeations,” TDA progress report 42-121, JPL, August 1995.

[0191]FIG. 26 is a TTCM decoder according to an embodiment of theinvention. FIG. 26 illustrates a block diagram of the TTCM decodercorresponding to the TTCM encoder described above. The TTCM decoderincludes a circular buffer 2602, a metric calculator module 2604, twosoft-in soft-out (SISO) modules 2606, 2608, two interleavers 2610, 2612,a conditional points processing module 2614, a first-in first-out (FIFO)register 2616, and an output processor 2618.

[0192] The TTCM decoder of FIG. 26 impliments a MAP (Maximum APosteriori) probability decoding algorithm.

[0193] The MAP Algorithm is used to determine the likelihood of thepossible particular information bits transmitted at a particular bittime.

[0194] Turbo decoders, in general, may employ a SOVA (Soft OutputViterbi Algorithm) for decoding. SOVA is derived from the classicalViterbi Decoding Algorithm (VDA). The classical VDA takes soft inputsand produces hard outputs a sequence of ones and zeros. The hard outputsare estimates of values, of a sequence of information bits. In general,the SOVA Algorithm takes the hard outputs of the classical VDA andproduces weightings that represent the reliability of the hard outputs.

[0195] The MAP Algorithm, implimented in the TTCM decoder of FIG. 26,does not produce an intermediate hard output representing the estimatedvalues of a sequence of transmitted information bits. The MAP Algorithmreceives soft inputs and produces soft outputs directly.

[0196] The input to the circular buffer i.e. input queue 2602 is asequence of received tuples. In the embodiments of the inventionillustrated in FIG. 26, each of the tuples is in the form of 8-bitin-phase (I) and 8-bit quadrature (Q) signal sample where each samplerepresents a received signal point or vector in the I-Q plane. Thecircular buffer 2602 outputs one tuple at a time to the metriccalculator 2604.

[0197] The metric calculator 2604 receives I and Q values from thecircular buffer 2602 and computes corresponding metrics representingdistances form each of the 8 members of the signal constellation (usinga designated MAP) to the received signal sample. The metric calculator2604 then provides all eight distance metrics (soft inputs) to the SISOmodules 2606 and 2608. The distance metric of a received sample pointfrom each of the constellation points represents the log likelihoodprobability that the received sample corresponds to a particularconstellation point. For rate ⅔, there are 8 metrics corresponding tothe points in the constellation of whatever map is used to encode thedata. In this case, the 8 metrics are equivalent to the Euclidean squaredistances between the value received and each of the constellationwhatever map is used to encode the data.

[0198] SISO modules 2606 and 2608 are MAP type decoders that receivemetrics from the metric calculator 2604. The SISOs then performcomputations on the metrics and pass the resulting A PosterioriProbability (APoP) values or functions thereof (soft values) to theoutput processor 2618.

[0199] The decoding process is done in iterations. The SISO module 2606decodes the soft values which are metrics of the received values of thefirst constituent code corresponding to the constituent encoder forexample 1703 (FIG. 17). The SISO module 2608 decodes the soft valueswhich are the APoP metrics of the received values of the secondconstituent code corresponding to the constituent encoder for example1709 (FIG. 17). The SISO modules simultaneously process both codes inparallel. Each of the SISO modules computes the metrics corresponding tothe input bits for every bit position of the in the block of 10K tuples(representing a exemplary block of date), and for each of the trellisstates that the corresponding encoder could have been in.

[0200] One feature of the TTCM decoder is that, during each iteration,the two SISO modules 2606, 2608 are operating in parallel. At theconclusion of each iteration, output from each SISO module is passedthrough a corresponding interleaver and the output of the interleaver isprovided as updated or refined A Priori Probability (APrP) informationto the input of other cross coupled SISO modules for the next iteration.

[0201] After the first iteration, the SISO modules 2706, 2708 producesoft outputs to the interleaver 2610 and inverse interleaver 2612,respectively. The interleaver 2610 (respectively, inverse interleaver2612) interleaves the output from the SISO module 2606 (respectively,2608) and provides the resulting value to the SISO module 2608(respectively, 2606) as a priori information for the next iteration.Each of the SISO modules use both the metrics from the metric calculator2604 and the updated APrP metric information from the other crosscoupled SISO to produce a further SISO Iteration. In the presentembodiment of the invention, the TTCM decoder uses 8 iterations in itsdecoding cycle. The number of iterations can be adjusted in firmware orcan be changed depending on the decoding process.

[0202] Because the component decoders SISO 2606 and 2608 operate inparallel, and because the SISO decoders are cross coupled, no additionaldecoders need to be used regardless of the number of iterations made.The parallel cross coupled decoders can perform any number of decodingcycles using the same parallel cross coupled SISO units (e.g. 2606 and2608).

[0203] At the end of the 8 iterations the iteratively processed APoPmetrics are passed to the output processor 2618. For code rate ⅔, theoutput processor 2618 uses the APoP metrics output from the interleaver2610 and the inverse interleaver 2612 to determine the 2 informationbits of the transmitted tuple. For code rate ⅚ or {fraction (8/9)}, theoutput from the FIFO 2616, which is the delayed output of theconditional points processing module 2614, is additionally needed by theoutput processor 2618 to determine the uncoded bit, if one is present.

[0204] For rate ⅔, the conditional points processing module 2614 is notneeded because there is no uncoded bit. For rate ⅚ or {fraction (8/9)},the conditional points processing module 2614 determines which points ofthe received constellation represent the uncoded bits. The outputprocessor 2618 uses the output of the SISOs and the output of theconditional points processor 2614 to determine the value of the uncodedbit(s) that was sent by the turbo-trellis encoder. Such methodology ofdetermining the value of an uncoded bit(s) is well known in the art asapplied to trellis coding.

[0205]FIG. 27 is a TTCM modulo-4 decoder according to an embodiment ofthe invention. The modulo four decoder of FIG. 27 is similar to themodulo-2 decoder illustration in FIG. 26. The functions of the inputqueue 2802, metric calculator 2804, conditional points processor 2814,and first in first out (FIFO) 2816 are similar to their counterparts inFIG. 26. The signals that will be decoded by the TTCM modulo-4 decoderFIG. 27 is one that has been coded in a modulo-4 interleaving system.Therefore, instead of having merely even and odd SISOs and interleavers,SISO 0,1, 2 and 3 are used as are interleaver 0,1, 2 and 3. Because thedata has been encoded using a modulo-4 interleaving system, SISOs 0, 1,2 and 3 can operate in parallel using interleaver 0, 1, 2 and 3. Oncethe SISOs 0 through 3 have processed through the points corresponding tothe metrics of the points received in the input queue, the points canthen be passed on to output process 2818. Output process 2818 will thenprovide decoded tuples.

[0206]FIG. 28 is a graphical illustration of a modulo-N and encoding anddecoding system according to an embodiment of the invention. In FIG. 28,the encoder 2800 is a modulo-N encoder. The modulo-N encoder illustratedhas N encoders and N−1 interleavers. The selector, 2801 selects encodedtuples sequentially from the output of encoders 0 through N. Selector2801 then passes the selection onto the mapper which applies theappropriate mapping. The appropriately mapped data is then communicatedover a channel 2803 to an input queue 2805. The functions of input 2805,metric calculator 2807, conditional points processor 2809 and FIFO 2811are similar to those illustrated in FIGS. 26 and 2478. The decoder 2813has N SISOs corresponding to the N encoders. Any desired amount ofparallelism can be selected for the encoder decoder system with the onecaveat that the modulo-N decoding must match the modulo-N encoding. Byincreasing the modulo of the system, more points which have beenproduced by the metric calculator 2807 can be processed at the sametime.

[0207] SISOs 0 through N process the points provided by the metriccalculator in parallel. The output of one SISO provides A Priori valuesfor the next SISO. For example SISO 0 will provide an A Priori value forSISO 1, SISO 1 will provide an A Priori value for SISO 2, etc. This ismade possible because SISO 0 impliments a Map decoding algorithm andprocesses points that have a modulo sequence position of 0 within theblock of data being processed, SISO 1 impliments a Map decodingalgorithm and processes points that have a modulo sequence position of 1within the block of data being processed, and so forth. By matching themodulo of the encoding system to the modulo of the decoding system thedecoding of the data transmitted can be done in parallel. The amount ofparallel processing available is limited only by the size of the datablock being processed and the modulo of the encoding and decoding systemthat can be implimented.

[0208]FIG. 29 is a graphical illustration of the output of the TTCMencoder illustrated in FIG. 17. FIG. 29 retains the same convention thatC stands for a coded bit. The output of the TTCM encoder of FIG. 17 isrepresented by the sequences 2901 and 2903. The tuple sequence 2901represents the actual output of rate ⅔rds encoder illustrated in FIG.17. During a first time period T₀, bits C₀, C₁ are output from theencoder. The source of bits C₀, C₁ and C₂ represent 3 bits encoded bythe even encoder 1709. These first 3 bits are mapped according tomapping sequence 2903. According to mapping sequence 2903 bits C₀, C₁and C₂ are mapped using map 0 as illustrated in FIG. 22. Together thetuple sequence and mapping identify the type of output of the rate ⅔rdsencoder illustrated in FIG. 17.

[0209] The tuple C₃, C₄ and C₅ is provided by the encoder of FIG. 17immediately after the tuple comprising C₀, C₁ and C₂. The tuple C₃, C₄and C₅ is been encoded in the odd encoder. The tuple sequence 2901corresponding to time T₁ is the result of an encoding performed in theodd encoder 1703.

[0210] In FIG. 29 through and including FIG. 33 the followingconventions are adopted. Even encoder outputs will be shaded a lightgray. The odd encoder outputs have no shading. In such a way the tuplesequence which comprises the output of the corresponding TTCM encodercan be identified. The gray shading denotes that the tuple was encodedin the even constituent encoder, and the lack of shading indicates thatthe tuple was encoded in the odd convolutional constituent encoder.Additionally uncoded bits that are associated with the even encoder datastream are shaded.

[0211] A letter C will represent a coded bit which is sent and anunderlined letter B will represent unencoded bits which have not passedthrough either constituent encoder and a B without the underline willrepresent a bit which is encoded, but transmitted in unencoded form.

[0212] In time sequence T₂ the TTCM output is taken from the evenencoder, accordingly the bit C₆, C₇ and C₈ appear as a gray shaded tuplesequence indicating that they were encoded by the even encoder. At timeT3 output tuple sequence 2901 comprises C₉, C₁₀ and C₁₁ which had beenencoded by the odd encoder. All members of the tuple sequence for therate ⅔rds encoder illustrated in FIG. 17 are mapped using map 0 as shownat mapping sequence 2903. The characterization of TTCM encoders outputtuples using tuple sequence and mapping sequence will be used later whenconsidering the decoding. For the present it is only necessary torealize that the combination of the tuple sequence and mapping sequencecorrespond to its type. The tuple type completely specifies the outputof the TTCM encoder for the purposes of decoding.

[0213]FIG. 30 is a graphical illustration of the tuple types produced bythe TTCM encoder illustrated in FIG. 18A. The TTCM encoder illustratedin FIG. 18A is a rate ½ encoder. The rate ½ encoder illustrated in FIG.18A produces output tuples comprising 2 bits. The first tuple pair C₀and C₁, corresponding to output time T₀, is produced by the even encoder1809 as indicated by the shading of the tuple. The next tuplecorresponding to output time T₁ comprises coded bits C₂ and C₃ whichhave been encoded by the odd encoder 1809. Similarly, the tuplecorresponding to time T₂ is produced by the even encoder and the tuplecorresponding to time T₃ is produced by the odd encoder. All tuplesequences 3001 are mapped using to map 0 as shown by the mappingsequence 3003. The combination of tuple sequence 3001 and mappingsequence 3003 comprise the type of the tuple produced by the rate ½ TTCMencoder of FIG. 18A. The type of tuples produced by the TTCM encoder ofFIG. 18A will be useful for the purposes of decoding the output tuples.

[0214]FIG. 31 is a graphical illustration illustrating the tuple typesproduced by the rate ¾ encoder of FIG. 19. The tuple sequence 3101,representing the output of the TTCM encoder of FIG. 19 is a sequence of4 bit tuples. The output tuple corresponding to time T₀ is 4 bits. C₀,C₁, C₂ and unencoded bit B₀. Tuple sequence corresponding to time T₀ ismapped by map 2 as shown by mapping sequence 3103. Additionally, thetuple sequence 3101 during time T₀ is mapped by the even encoder, asillustrated by the shading. In other words, the uncoded bit B ₀ does notpass through either the even or odd encoder. It is however shown shadedas the tuple sequence, to which it is paired, is produced by the evenencoder 1909.

[0215] Similarly, the tuple sequence corresponding to T₂ has beenproduced by the even encoder. The tuple sequence corresponding to timeT₂, i.e. C₆, C₇ and C₈, are produced by even encoder 1909 and pairedwith unencoded bit B ₂. C₆, C₇ and C₈ are produced by the even encoder.Combination C₆, C₇, C₈ and B ₂ are mapped according to map 2 asillustrated in FIG. 24.

[0216] Similarly, the tuple sequences produced by the TTCM encoder ofFIG. 19 during times T₁ and T₃ are produced by the odd encoder andcombined with an uncoded bit. During time T₁ the odd encoder encodes C₃,C₄ and C₅. C₃, C₄ and C₅ along with B₁, are mapped in map 2. The tuplesequence produced during time T₃ is also a combination of the oddencoder and an encoded bit. As illustrated in FIG. 31 all tuplesequences are mapped using map 2.

[0217]FIG. 32 is a graphical illustration of the tuple types produced bythe rate ⅚ encoder illustrated in FIG. 20A. The first tuplecorresponding to time T₀ comprises coded bits C₀, C₁ and C₂. The codedbits C₀, C₁ and C₂ are mapped according to map 0. During time T₁, bitsB₀, B₁ and B ₂ are produced by the encoder of FIG. 20A. B₀, B₁ and B ₂represent data that is sent uncoded they are however shown as beinggrayed out because bits B₁ and B₀ pass through the even encoder eventhough they are sent in uncoded form. The uncoded bits B₀, B₁ and B ₂are mapped using map 1. Similarly, the output of the encoder at time T₄comprises coded bits C₆, C₇ and C₈ which are mapped using map 0. Duringtime period T₅ uncoded bits B₆, B₇ and B ₈ form the output of theencoder. B₆, B₇ and B ₈ are mapped using map 1.

[0218] During time period T₂, bits C₃, C₄ and C₅ are selected from theodd encoder as the output of the overall ⅚ encoder illustrated in FIG.20A. Bits C₃, C₄ and C₅ are mapped in mapper 0 and form the turbotrellis coded modulated output. Similarly, during time T₆, bit C₉, C₁₀and C₁₁ are selected from the odd encoder and mapped according to map 0.During time period T₇, uncoded bits B₉, B₁₀ and B₁₁ are selected as theoutput of the rate ⅚ encoder and are mapped according to map 1. Thechart of FIG. 32 defines the types of output produced by the rate ⅚encoder of FIG. 20A.

[0219]FIG. 33 is a chart defining the types of outputs produced by the{fraction (8/9)}th encoder illustrated in FIG. 21A All uncoded outputsare mapped according to map 1. All coded outputs are mapped according tomap 0. During times T₀ and T₆ coded outputs from the even encoder areselected. During times T₃ and T₉ coded output from the odd encoder areselected. Accordingly, the tuple types produced by the rate {fraction(8/9)}ths encoder of FIG. 21 are completely described by theillustration of FIG. 33.

[0220]FIG. 34 is a further graphical illustration of a portion of thedecoder illustrated in FIG. 26. In FIG. 34 the circular buffer 2602 isfurther illustrated as being a pair of buffers 3407 and 3409. Switches3401, 3403, 3405 and 3407 operate in such a fashion as to enable themetric calculator 3411 to receive data from one buffer while the otherbuffer is accepting data. In such a fashion one buffer can be used forprocessing input data by providing it to the metric calculator and thesecond buffer can be used for receiving data. The metric calculator 3411receives data, as required, from either buffer 3407 or buffer 3409 andcalculates the distance between the received point and designated pointsof the data constellation produced by the source encoder. The symbolsequencer 3413 provides data to the metric calculator 3411 specifyingthe type of tuple, i.e. the constellation and bit encoding of the tuple,which is being decoded. The symbol sequencer also provides informationto either buffer 3407 and 3409 regarding which data bits are to beprovided to the metric calculator 3411. The symbol sequencer isgenerally provided information, regarding the symbol types to bereceived, during the initialization of the system. Symbol typing hasbeen discussed previously with respect to FIGS. 29 through 33. Themetric calculator 3411 calculates the metrics for each received point.The metrics for a particular receive point will typically comprise 8Euclidean distance squared values for each point as indicated at theoutput of metric calculator 3411. The Euclidean distance of a point isillustrated in FIG. 35.

[0221] The metric calculator 3411 of FIG. 34 has two outputs 3415 and3417. The output 3415 represents eight metrics each of six bitscorresponding to the Euclidian distance squared in the I-Q plane betweena received point and all eight possible points of the signalconstellation which represent valid received data points. Output 3417represents the mapping of an encoded bit, if any is present. The output3417 is an indicator of how to select the value of an uncoded bit. Thevalue of the eight outputs at 3417 correspond to a 0 or 1 indicatingwhether the receive point is closer to an actual point in which theuncoded bit would assume a value of 0 or 1. The method of includinguncoded bits within a constellation has been well known in the art andpracticed in connection with trellis coded modulation. It is includedhere for the sake of completeness. The uncoded bit metrics will bestored in FIFO 2616 until the corresponding points are decoded in theoutput processor 2618. Once the corresponding points are decoded in theoutput processor 2618, they can be matched with the proper value for theuncoded bit as applied by FIFO 2616.

[0222]FIG. 35 is a graphical illustration of the process carried onwithin the metric calculator of the decoder. In FIG. 35, a constellationof designated points is represented in the I-Q plain by points 3503,3505, 3507, 3509, 3511, 3513, 3515 and 3517. The points just mentionedconstitute an exemplary constellation of transmitted point values. Inactual practice a received point may not match any of the designatedtransmission points of the transmitted constellation. Further a receivedpoint matching one of the points in the constellation illustrated maynot coincide with the point that had actually been transmitted at thetransmitter. A received point 3501 is illustrated for exemplary purposesin calculating Euclidean squared distances. Additionally, point 3519 isillustrated at the 00 point of the I-Q plain. Point 3519 is a pointrepresenting a received point having an equal probability of being anypoint in the transmitted constellation. In other words, point 3519 is apoint having an equal likelihood of having been transmitted as anyconstellation point. Point 3519 will be used in order to provide aneutral value needed by the decoder for values not transmitted.

[0223] The metric calculator 3411 calculates the distance between areceive point, for example 3501, and all transmitted points in theconstellation, for example, points 3503 and 3505. The metric calculatorreceives the coordinates for the receive points 3501 in terms of 8 bitsI and 8 bits Q value from which it may calculate Euclidean distancesquared between the receive point and any constellation point. Forexample, if receive point 3501 is accepted by the metric calculator 3411it will calculate value X(0) and Y(0), which are the displacement in theX direction and Y direction of the receive point 3501 from theconstellation pointer 3503. The values for X(0) and Y(0) can then besquared and summed and represent D²(0). The actual distance between areceive point 3501 and a point in the constellation, for example 3503can then be computed from the value for D²(0). The metric calculatorhowever, dispenses with the calculation of the actual value of D(0) andinstead employs the value D²(0) in order to save the calculation timethat would be necessary to compute D(0) from D²(0). In like manner themetric calculator then computes the distance between the receive pointand each of the individual possible points in the constellation i.e.3503 through 3517.

[0224]FIG. 36 is a graphical illustration of the calculation of aEuclidean squared distance metric. Once the metric values representingthe 8 metrics have been calculated, the metric calculator 2604 can thenprovide them to the SISOs 2606 and 2608.

[0225] SISOs 2606 and 2608 of FIG. 34 accept the values from the metriccalculator 3411. SISO 2606 decodes points corresponding to the oddencoder an SISO 2608 decodes point corresponding to the even encoder.SISOs 2606 and 2608 operate according to a map decoding algorithm.Within each SISO is a trellis comprising a succession of statesrepresenting all of the states of the odd or even encoder. The valuesassociated with each state represent that probability that the encoderwas in that particular state during the time period associated with thatparticular state. Accordingly, SISO 2606 decodes the odd encoder trellisand SISO 2608 decodes the even encoder trellis. Because only the oddpoints are accepted for transmission from the odd encoder SISO 2606 maycontain only points corresponding to odd sequence designations and SISO2608 contains only points corresponding to even sequence designations.These are the only values supplied by the metric calculator becausethese are the only values selected for transmission. Accordingly, inconstructing the encoder trellis for both the odd encoder within SISO2606 and the even encoder within SISO 2608 every other value is absent.Because a trellis can only represent a sequence of values, every otherpoint, which is not supplied to each SISO must be fabricated in somemanner. Because every other point in each of the two SISOs is an unknownpoint, there is no reason to presume that one constellation point ismore likely than any other constellation point. Accordingly, the pointsnot received by the SISOs from the metric calculator are accorded thevalue of the 0 point 3519. The 00 point 3519 is chosen because it isequidistant, i.e. equally likely, from all the possible points in theencoded constellation.

[0226]FIG. 37 is a representation of a portion of a trellis diagram asmay be present in either SISO 2606 or SISO 2608. The diagram illustratesa calculation of the likelihood of being in state M 3701. The likelihoodof being in state M, 3701 is calculated in two different ways. Thelikelihood of being in state M 3701 at time k is proportional to thelikelihood that a time K−1 that the encoder was in a state in which thenext successive state could be state M (times the likelihood that thetransmission was made into state M). In the trellis diagram state M maybe entered from precursor states 3703, 3705, 3707 or 3709. Therefore,the likelihood of being in state M 3701 is equal to the likelihood ofbeing in state 3701, which state 0 of the encoder, and is symbolized byα_(k)(0).

[0227] The likelihood of being in state M 3701 may be evaluated usingprevious and future states. For example, if state M 3701 is such that itmay be entered only from states 3703, 3705, 3707 or 3709, then thelikelihood of being in state M 3701 is equal to the summation of thelikelihoods that it was in state 3703 and made a transition to state3701, plus the likelihood that the decoder was in state 3705 and madethe transition to state 3701, plus the likelihood that the decoder wasin state 3707 and made the transition to state 3701, plus the likelihoodthat the decoder was in state 3709 and made the transition to state3701.

[0228] The likelihood of being in state M 3701 at time k may also beanalyzed from the viewpoint of time k+1. That is, if state M 3701 cantransition to state 3711, state 3713, state 3715, or state 3717, thenthe likelihood that the decoder was in state M 3701 at time k is equalto a sum of likelihoods. That sum of likelihoods is equal to thelikelihood that the decoder is in state 3711 at time k+1 and made thetransition from state 3701, plus the likelihood that the decoder is instate 3713 at time k+1, times the likelihood that it made the transitionfrom state M 3701, plus the likelihood that it is in state 3715 and madethe transition from state 3701, plus the likelihood that it is in state3717 and made the transition from state M 3701. In other words, thelikelihood of being in a state M is equal to the sum of likelihoods thatthe decoder was in a state that could transition into state M, times theprobability that it made the transition from the precursor state tostate M, summed over all possible precursor states.

[0229] The likelihood of being in state M can also be evaluated from apost-cursor state. That is, looking backwards in time. To look backwardsin time, the likelihood that the decoder was in state M at time k isequal to the likelihood that it was in a post-cursor state at time k+1times the transition probability that the decoder made the transitionfrom state M to the post-cursor state, summed over all the possiblepost-cursor states. In this way, the likelihood of being in a decoderstate is commonly evaluated both from a past and future state. Althoughit may seem counter-intuitive that a present state can be evaluated froma future state, the problem is really semantic only. The decoder decodesa block of data in which each state, with the exception of the firsttime period in the block of data and the last time period in the blockof data, has a precursor state and a post-cursor state represented. Thatis, the SISO contains a block of data in which all possible encoderstates are represented over TP time periods, where TP is generally thelength of the decoder block. The ability to approach the probability ofbeing in a particular state by proceeding in both directions within theblock of data is commonly a characteristic of map decoding.

[0230] The exemplary trellis depicted in FIG. 37 is an eight statetrellis representing the eight possible encoder states. Additionally,there are a maximum of four paths into or out of any state, because theconstituent encoders which created the trellis in FIG. 37 had 2-bitinputs. Such a constituent encoder is illustrated in FIG. 5. In fact,FIG. 37 is merely an abbreviated version of the trellis of the righttwo-thirds constituent encoder illustrated in FIG. 6, with an additionaltime period added.

[0231] The state likelihoods, when evaluating likelihoods in the forwarddirection, are termed the “forward state metric” and are represented bythe Greek letter alpha (a). The state likelihoods, when evaluating thelikelihood of being in a particular state when evaluated in the reversedirection, are given the designation of the Greek letter beta (β). Inother words, forward state metric is generally referred to as α, and thereverse state metric is generally referred to as β.

[0232]FIG. 38 is a generalized illustration of a forward state metricalpha (α) and a reverse state metric beta (β). The likelihood of beingin state 3808 at time k is designated as α_(k). α_(k) designates theforward state metric alpha at time k for a given state. Therefore, α_(k)for state 3808 is the likelihood that the encoder was in a trellis stateequivalent to state 3808 at time k. Similarly, at time k−1, thelikelihood that the encoder was in a state equivalent to state 3801 attime α_(k−1) is designated as α_(k−1) (3801). The likelihood that theencoder was in state 3809 at time k−1 is equal to α_(k−1) (3809).Similarly, at time k−1, the likelihood that the encoder was in state3818 at time k−1 is equal to α_(k−1) (3813). Similarly, the likelihoodthat the encoder was in a state equivalent to state 3817 at time k−1 isequal to α_(k−1) (3817). Therefore, to compute the likelihood that theencoder is in state 3803, the likelihood of being in a precursor statemust be multiplied by the likelihood of making the transition from aprecursor state into state 3803.

[0233] The input at the encoder that causes a transition from a state3801 to 3803 is an input of 0,0. The likelihood of transition betweenstate 3801 and state 3803 is designated as δ(0,0) (i.e. delta (0,0)).Similarly, the transition from state 3809 to 3803 represents an input of0,1, the likelihood of transition between state 3809 and state 3803 isrepresented by delta (0,1). Similarly, the likelihood of transitionbetween state 3813 and 3803 is represented by delta (1,0) as a 1,0 mustbe received by the encoder in state 3813 to make the transition to state3803. Similarly, a transition from state 3817 to state 3803 can beaccomplished upon the encoder receiving a 1,1, and therefore thetransition between state 3817 and state 3803 is the likelihood of thattransition, i.e. δ(1,1). Accordingly, the transition from state 3801 to3803 is labeled δ₁(0,0) indicating that this is a first transitionprobability and it is the transition probability represented by an inputof 0,0. Similarly, the transition likelihood between state 3809 and 3803is represented by δ₂ (0,1), the transition between state 3813 and state3803 is represented by δ₃ (1,0), and the likelihood of transitionbetween state 3817 and 3803 is represented by δ₄ (1,1).

[0234] The situation is similar in the case of the reverse state metric,beta (β). The likelihood of being in state 3807 at time k+1 isdesignated β_(k+1) (3807). Similarly, the likelihood of being in reversemetric states 3811, 3815, 3819 and 3805 are equal to β_(k+1) (3811),β_(k+1) (3815), β_(k+1) (3819), and β_(k) (3805). Likewise, theprobability of transition between state 3805 and 3807 is equal to δ₁(0,0), the likelihood of transition between state 3805 and 3811 is equalto δ₅ (0,1). The likelihood of transition from state 3805 to 3815 isequal to δ₆ (1,0), and the likelihood of transition between state 3805and 3819 is equal to δ₇(1,1). In the exemplary illustrated of FIG. 38,there are four ways of transitioning into or out of a state. Thetransitions are determined by the inputs to the encoder responsible forthose transitions. In other words, the encoder must receive a minimum oftwo bits to decide between four different possible transitions. Byevaluating transitions between states in terms of 2-bits inputs to theencoder at a given time, somewhat better performance can be realizedthan by evaluating the decoding in terms of a single bit at a time. Thisresult may seem counter-intuitive, as it might be thought thatevaluating a trellis in terms of a single bit, or in terms of multiplebits, would be equivalent. However, by evaluating the transitions interms of how the input is provided at a given time, a somewhat betterperformance is obtained because the decoding inherently makes use of thenoise correlation which exists between two, or more, simultaneous inputbits.

[0235] Accordingly, the likelihood of being in state 3701 may berepresented by expression 1. $\begin{matrix}\begin{matrix}{{\alpha_{k}(3701)} = \quad {{{\alpha_{k - 1}(3703)} \times {\delta_{1}(00)} \times {{app}(00)}} + {{\alpha_{k - 1}(3705)} \times}}} \\{\quad {{{\delta_{2}(01)} \times {{app}(01)}} + {{\alpha_{k - 1}(3707)} \times {\delta_{3}(10)} \times}}} \\{\quad {{{app}(10)} + {{\alpha_{k - 1}(3709)} \times {\delta_{4}(11)} \times {{{app}(11)}.}}}}\end{matrix} & \left( {{Expr}.\quad 1} \right)\end{matrix}$

[0236] Similarly, β_(k) can be represented by expression 2:$\begin{matrix}\begin{matrix}{{\beta_{k}(3701)} = \quad {{{\delta_{1}(00)} \times {\beta_{k + 1}(3711)} \times {{app}(00)}} + {{\delta_{5}(01)} \times}}} \\{\quad {{{\beta_{k + 1}(3713)} \times {{app}(01)}} + {{\delta_{6}(10)} \times {\beta_{k + 1}(3715)} \times}}} \\{\quad {{{app}(10)} + {{\delta_{7}(11)} \times {\beta_{k + 1}(3717)} \times {{{app}(11)}.}}}}\end{matrix} & \left( {{Expr}.\quad 2} \right)\end{matrix}$

[0237]FIG. 39A is a block diagram further illustrating the parallelSISOs illustrated in FIG. 26. Both SISOs, 2606 and 2608, accept channelmetrics 3905, which are provided by the metric calculator 2604. SISO2606 decodes the trellis corresponding to the encoding of the oddencoder. SISO 2608 decodes the trellis corresponding to the evenencoder. The even and odd encoders may be, for example, the even and oddencoders illustrated in FIGS. 17 through 21. SISO 2606 will acceptchannel metrics corresponding to even encoded tuples and SISO 2608 willaccept channel metrics corresponding to odd tuples. SISO 2606 assignsthe zero point, i.e., the point with equally likely probability of beingany of the transmitted points, as a metric for all the even points inits trellis. Similarly, SISO 2608 assigns the 0,0 point, a point equallylikely to be any constellation point, to all odd points in its trellis.The extrinsic values 3909 computed by SISO 2606 become the A Priorivalues 3913 for SISO 2608. Similarly, the extrinsic values 3915,computed by SISO 2608, become the A Priori values 3907 for SISO 2606.After a final iteration, SISO 2606 will provide A Posteriori values 3911to the output processor 2618. Similarly, SISO 2608 will provide APosteriori values 3917 to the output processor 2618. The SISO pair ofFIG. 39A comprise an even/odd, or modulo-2 decoder. As indicatedearlier, neither the encoding nor the decoding systems disclosed herein,are limited to even and odd (modulo 2) implementations and may beextended to any size desired. To accommodate such modulo-N systems,additional SISOs may be added. Such systems may achieve even greaterparallelism then can systems employing only 1 SISO.

[0238]FIG. 39B is a block diagram of a modulo-N type decoder. A modulo-Ndecoder is one having N SISOs. A modulo-N decoder can provide paralleldecoding for parallel encoded data streams, as previously discussed.Parallel decoding systems can provide more estimates of the points beingdecoded in the same amount of time as non-parallel type systems take. InFIG. 39B, channel metrics 3951 are provided to end SISOs 3957, 3965,3973, and 3983. SISO 3973 may represent multiple SISOs. Such a modulo-Ndecoding system may have any number of SISOs desired. If a modulo-Nencoding system is paired with a modulo-N decoding system, as disclosedherein, the decoding can take place in parallel, and may providesuperior decoding for the same amount of time that a serial decoderwould use. SISO 3957 computes an extrinsic value 3955, which becomes theA Priori value 3961 for SISO 3965. SISO 3965 computes an extrinsic value3963, and then provides it as an A Priori value 3969 to SISO chain 3973.SISOs 3973 may comprise any number of SISOs configured similarly to SISO3965. The final SISO in the SISO chain 3973 provides an extrinsic value3971, which becomes an A Priori value 3977 for SISO 3983. The extrinsicvalue 3979, computed by SISO 3983, can provide an A Priori value 3953for SISO 3957. Each SISO then can provide A Posteriori values, i.e.,3959, 3967, 3981, and the series of Δ Posteriori values 3975, to anoutput processor such as illustrated at 2718.

[0239]FIG. 40 is a block diagram illustrating the workings of a SISOsuch as that illustrated at 2606, 3957, 2606 or 2701. The inputs to theSISO 4000 comprise the channel metrics 4001 and the A Priori values4003. Both the A Priori value 4003 and the channel metrics 4001 areaccepted by the alpha computer 4007. The A Priori values and channelmetrics are also accepted by a latency block 4005, which provides thedelays necessary for the proper internal synchronization of the SISO4000. The alpha computer 4007 computes alpha values and pushes them on,and pops them from, a stack 4017. The output of the alpha computer alsois provided to a dual stack 4009.

[0240] Latency block 4005 allows the SISO 4000 to match the latencythrough the alpha computer 4007. The dual stack 4009 serves to receivevalues from the latency block 4005 and the alpha computer 4007. Whileone of the dual stacks is receiving the values from the alpha computerand the latency block, the other of the dual stacks is providing valuesto the Ex. Beta values are computed in beta computer 4011, latency block4013 matches the latency caused by the beta computer 4011, the alpha tobeta values are then combined in metric calculator block 4015, whichprovides the extrinsic values 4017, to be used by other SISOs as APriori values. In the last reiteration, the extrinsic values 4017 plusthe A Priori values will provide the A Posteriori values for the outputprocessor.

[0241] SISO 4000 may be used as a part of a system to decode varioussize data blocks. In one exemplary embodiment, a block of approximately10,000 2-bit tuples is decoded. As can be readily seen, in order tocompute a block of 10,000 2-bit tuples, a significant amount of memorymay be used in storing the α values. retention of such large amounts ofdata can make the cost of a system prohibitive. Accordingly, techniquesfor minimizing the amount of memory required by the SISO's computationcan provide significant memory savings.

[0242] A first memory savings can be realized by retaining the I and Qvalues of the incoming constellation points within the circular buffer2602. The metrics of those points are then calculated by the metriccalculator 2604, as needed. If the metrics of the points retained in thecircular buffer 2602 were all calculated beforehand, each point wouldcomprise eight metrics, representing the Euclidian distance squaredbetween the received point and all eight possible constellation points.That would mean that each point in circular buffer 2602 would translateinto eight metric values, thereby requiring over 80,000 memory slotscapable of holding Euclidian squared values of the metrics calculated.Such values might comprise six bits or more. If each metric valuecomprises six bits, then six bits times 10,000 symbols, times eightmetrics per symbol, would result in nearly one-half megabit of RAM beingrequired to store the calculated metric values. By calculating metricsas needed, a considerable amount of memory can be saved. One difficultywith this approach, however, is that in a system of the type disclosed,that is, one capable of processing multiple types of encodings, themetric calculator must know the type of symbol being calculated in orderto perform a correct calculation. This problem is solved by the symbolsequencer 3413 illustrated in FIG. 34.

[0243] The symbol sequencer 3413 provides to the metric calculator 3411,and to the input buffers 3407 and 3409, information regarding the typeof encoded tuple received in order that the metric calculator andbuffers 3407 and 3409 may cooperate and properly calculate the metricsof the incoming data. Such input tuple typing is illustrated in FIGS. 29through 33, and has been discussed previously.

[0244]FIG. 41 is a graphical representation of the processing of alphavalues within a SISO such as illustrated at 2606, 4000 or 2606. Onecommon method for processing alpha values is to compute all the alphavalues in a block. Then the final alpha values can be used with theinitial beta values in order to calculate the state metrics. If theblock of data that is being processed is large, such as the exemplary10,000 two-bit tuple block exemplarily calculated in SISO 4000, then asignificant amount of memory must be allotted for storing the alphavalues computed. An alternate method of processing alpha values isemployed by the SISO unit 4000. In order to save memory, all the alphavalues are not stored. The α value data matrix within the SISO isdivided into a number of sub-blocks. Because the sub-block size may notdivide equally into the data block size, the first sub-block may besmaller than all of the succeeding sub-blocks which are equally sized.In the example illustrated in FIG. 41, the sub-block size is 125elements. The first sub-block numbered α 0 through α 100 is selected ashaving 101 elements in order that all the other sub-blocks may be ofequal size, that is 125 elements. The alpha computer successivelycomputes alpha values, α 0, α 1, etc. in succession. The alpha valuesare not all retained but are merely used to compute the successive alphavalues. Periodically an α value is pushed on a stack 4103. So, forexample, α value, α 100, is pushed on stack 4103 as a kind of acheckpoint. Thereafter, another 125 α values are computed and notretained. The next alpha value (alpha 225) is pushed on stack 4103. Thisprocess continues in succession with every 126^(th) value being pushedon stack 4103 until a point is reached in which the alpha computed isone sub-block size away from the end of the data block contained withinthe SISO. So, for example, in the present case illustrated in FIG. 42,the point is reached in a block of size N when α (N−125) is reached,i.e. 125 α values from the end of the block. When the beginning of thisfinal sub-block within the SISO is encountered, all alpha values arepushed on a second stack 4009. The stack 4009 will then contain allalpha values of the last sub-block. This situation is illustratedfurther in FIG. 42.

[0245]FIG. 42 is a graphical illustration of the alpha processing withinthe SISO 4000. The alpha values are processed in sub-blocks of data. Forthe purposes of illustration, a sub-block of data is taken to be 126alpha values. A sub-block, however, may be of various sizes depending onthe constraints of the particular implementation desired. The alphablock of data is illustrated at 4200 in FIG. 42. The first step inprocessing the alpha block 4200 is to begin at the end of block 4215 anddivide the block 4200 into sub-blocks. Sub-blocks 4219, 4221 and 4223are illustrated in FIG. 42. Once the block 4200 has been divided intosub-blocks marked by checkpoint values 4209, 4207, 4205, 4203 and 4201,the processing may begin. Alpha computer 4007 begins calculating alphavalues at the beginning of the block, designated by 4217. Alpha valuesare computed successively and discarded until alpha value 4209, i.e., acheckpoint value, is computed. The checkpoint value 4209 is then pushedon stack 4019. Alpha computer 4007 then continues to compute alphavalues until checkpoint value 4207 is reached. Once checkpoint value4207 is reached, it is pushed on stack 4019. The distance betweencheckpoint value 4209 and checkpoint value 4207 is 125 values, i.e., onesub-block. Similarly, alpha values are computed from 4207 to 4205 anddiscarded. Checkpoint value 4205 is then pushed on stack 4019 and theprocess continues. The alpha computer then computes alpha values andcontinues to discard them until checkpoint value 4203 is reached. Atwhich point, checkpoint value 4203 is pushed on the stack 4019. Thealpha computer once again begins computing alpha values starting withalpha value 4203 until, 125 alpha values have been computed and thebeginning of sub-block 4219 is reached. Sub-block 4219 is the finalsub-block. The alpha computer 4007 computes alpha values for sub-block4219 pushing every alpha value on stack A 4009. Because sub-block 4219contains 125 elements, once the alpha computer has computed all ofsub-block 4219, stack A will contain 125 alpha values. Once the alphavalues for sub-block 4219 have been computed, the alpha computer willthen pop value 4203 off stack 4019 and begin to compute each and everyvalue for sub-block 4221. Values for sub-block 4221 are pushed on stackB 4009. While the values for sub-block 4221 are being pushed on stack B4009, the previous values which had been pushed on stack A 4009 arebeing popped from the stack. Beta values 4211, which are computed in theopposite direction of the alpha values, are computed beginning with theend of block 4200 marked at 4215. The beta values 4211 are combined withthe alpha values, as they are popped from stack A 4009, in the extrinsiccalculator 4015. The beta values 4211 and the alpha values from stack A4009 are combined until the last alpha element has been popped fromstack A 4009. Once stack A 4009 has been emptied, it may once againbegin receiving alpha values. Checkpoint alpha value 4205 is popped fromstack 4019 and used as a starting value for the alpha computer 4007. Thealpha computer may then compute the alpha values for sub-block 4223 arepushed onto the just emptied stack A 4009. While the alpha values arebeing computed and pushed on stack A 4009, the alpha values are beingpopped from stack B 4009 and combined with beta values 4213 in extrinsiccalculator 4015.

[0246] In the manner just described, the SISO computes blocks of dataone sub-block at a time. Computing blocks of data one sub-block at atime limits the amount of memory that must be used by the SISO. Insteadof having to store an entire block of alpha values within the SISO forthe computation, only the sub-block values and checkpoint values arestored. Additionally, by providing two stacks 4009 A and B, onesub-block can be processed while another sub-block is being computed.

[0247]FIG. 43 is a block diagram further illustrating the read-writearchitecture of the interleaver and deinterleaver of the decoder asillustrated in FIG. 26. The interleaver and deinterleaver areessentially combined utilizing eight RAM blocks 4303, 4305, 4307, 4309,4311, 4313, 4315, and 4317. The addressing of the eight RAMs iscontrolled by a central address generator 4301. The address generatoressentially produces eight streams of addresses, one for each RAM. Eachinterleaver and deinterleaver takes two sets of values and also producestwo sets of values. There are eight RAM blocks because each input tupledata point, comprising two bits, has each bit interleaved anddeinterleaved separately. As the alpha and beta computations are beingperformed in the SISOs, the a priori information is being read from aninterleaver and deinterleaver. While the information is being read froman interleaver and deinterleaver, an iteration computation is proceedingand values are being written to the interleavers and deinterleavers.Therefore, at any time point, four separate RAMs may be in the processof being written to, and four separate RAMs may be in the process ofbeing read. The generation of address sequences for theinterleaver/deinterleavers of the SISO system is somewhat complex.

[0248]FIG. 44 is a graphical illustration illustrating the generation ofdecoder sequences for the interleaver/deinterleaver addressingillustrated in FIG. 43. Since the decoder sequences are somewhat long,and may be greater than 10,000 addresses in length, short examples areused to illustrate the principles involved. A portion of the memory ofaddress generator 4301 is illustrated at 4415. Within the memory 4415,an interleave sequence is stored. The interleave sequence is stored asillustrated by arrows 4401 and 4403. That is, the interleave sequence isstored in a first direction, then in a second direction. In such amanner, address 0, illustrated at 4417 stores the interleave positionfor the first and last words of the interleave sequence. The next memorylocation, after 4417 will store the interleave position for the secondand the second to last words in the block, and so forth. The storage ofsequences is done in this manner the interleave and deinterleavesequences for encoded bit 1 is the time reversal of the interleavesequence for encoded bit 0. In such a way, interleave sequences for thetwo information bits which are st interleaved may be stored with noincreased storage requirement over a sequence being stored for just oneof the bits, i.e. a system in which the two information bits are itinterleaved. In such a manner, a sequence for a bit interleaver can beachieved using the same amount of data to store that sequence as wouldbe the case for a two-bit it interleaver. Theinterleaving/deinterleaving sequence for one of the two information bitsis the time reversal of the interleaving/deinterleaving sequence for theother information bit. For the practical purposes of interleaving anddeinterleaving, the sequences thus generated are effectivelyindependent.

[0249] A second constraint that the interleave sequence has is that oddpositions interleave to odd positions and even positions interleave toeven positions in order to correspond to the encoding method describedpreviously. The even and odd sequences are used by way of illustration.The method being described can be extended to a modulo N-type sequencewhere N is whatever integer value desired. It is also desirable toproduce both the sequence and the inverse sequence without having therequirement of storing both. The basic method of generating both thesequence and the inverse sequence is to use a sequence in a first caseto write in a permuted manner to RAM according to the sequence, and inthe second case to read from RAM in a permuted manner according to thesequence. In other words, in one case the values are writtensequentially and read in a permuted manner, and in the second case theyare written in a permuted manner and read sequentially. This method isbriefly illustrated in the following. For a more thorough discussion,refer to the previous encoder discussion. In other words, an addressstream for the interleaving and deinterleaving sequence of FIG. 43 canbe produced through the expedient of writing received data sequentiallyand then reading it according to a permuted sequence, as well as writingdata according to a permuted sequence and then reading it sequentially.Additionally, even addresses must be written to even addresses and oddaddresses must be written to odd addresses in the example decoderillustrated. Of course, as stated previously, this even odd, modulo 2,scheme may be extended to any modulo level.

[0250] As further illustration, consider the sequence of elements A, B,C, D, E, and F 4409. Sequence 4409 is merely a permutation of a sequenceof addresses 0, 1, 2, 3, 4, and 5, and so forth, that is, sequence 4411.It has been previously shown that sequences may be generated whereineven positions interleave to even positions and odd positions interleaveto odd positions. Furthermore, it has been shown that modulointerleaving sequences, where a modulo N position will always interleaveto a position having the same modulo N, can be generated. Another way togenerate such sequences is to treat the even sequence as a completelyseparate sequence from the odd sequence and to generate interleavingaddresses for the odd and even sequences accordingly. By separating thesequences, it is assured that an even address is never mapped to an oddaddress or vice-versa. This methodology can be applied to modulo Nsequences in which each sequence of the modulo N sequence is generatedseparately. By generating the sequences separately, no writing to orreading from incorrect addresses will be encountered.

[0251] In the present example, the odd interleaver sequence is theinverse permutation of the sequence used to interleave the evensequence. In other words, the interleave sequence for the even positionswould be the deinterleave sequence for the odd positions and thedeinterleave sequence for the odd positions will be the interleavesequence for the even positions. By doing so, the odd sequence and evensequence generate a code have the same distant properties. Furthermore,generating a good odd sequence automatically guarantees the generationof a good even sequence derived from the odd sequence. So, for example,examining the write address for one of the channels of the sequence asillustrated in 4405. The sequence 4405 is formed from sequences 4409 and4411. Sequence 4409 is a permutation of sequence 4411, which isobviously a sequential sequence. Sequence 4405 would then represent thewrite addresses for a given bit lane (the bits are interleavedseparately, thus resulting in two separate bit lanes). The inversesequence 4407 would then represent the read addresses. The interleavesequence for the odd positions is the inverse of the interleave sequencefor the odd positions. So while positions A, B, C, D, E and F arewritten to, positions 0, 1, 2, 3, 4, and 5 would be read from.Therefore, if it is not desired to write the even and odd sequence toseparate RAMs, sequences 4405 and 4407 may each be multiplied by 2 andhave a 1 added to every other position. This procedure of ensuring thatthe odd position addresses specify only odd position addresses and evenposition addresses interleave to only even position addresses is thesame as discussed with respect to the encoder. The decoder may proceedon exactly the same basis as the encoder with respect to interleaving toodd and even positions. All comments regarding methodologies forcreating sequences of interleaving apply to both the encoder anddecoder. Both the encoder and decoder can use odd and even or modulo Ninterleaving, depending on the application desired. If the interleaveris according to table 4413 with the write addresses represented bysequence 4405 and the read addresses represented by 4407, then thedeinterleaver would be the same table 4413 with the write addressesrepresented by sequence 4407 and the read addresses represented bysequence 4405. Further interleave and deinterleave sequences can begenerated by time reversing sequences 4405 and 4407. This is shown intable 4419. That is, the second bit may have an interleaving sequencecorresponding to a write address represented by sequence 4421 of table4419 and a read address of 4422. The deinterleaver corresponding to awrite sequence of 4421 and a read sequence of 4422 will be a readsequence of 4422 and a write sequence of 4421.

[0252]FIG. 45 is a graphical illustration of a decoder trellis accordingto an embodiment of the invention. A decoder trellis, in general,represents possible states of the encoder, the likelihood of being inindividual states, and the transitions which may occur between states.In FIG. 45, the encoder represented is a turbo trellis coded modulationencoder having odd even interleaving and constituent encoders asillustrated in FIG. 5. In FIG. 45, a transition into state 0 at timeequal to k+1 is illustrated. The likelihood that the encoder is in state0 at time k+1 is proportional to α_(k+1) (0), i.e., state 4511. To endup in state 4511, at time k+1, the encoder had to be in state 0, state1, state 2, or state 3 at time k. This is so because, as illustrated inFIG. 45, the precursor state for state 4511 is stated 4503, 4505, 4507or 4509 only. These transitions are in accordance with the trellisdiagram of FIG. 6. Accordingly, the enter state 4511 at time k+1, theencoder must be in state 4503 and transit along path number 1, or theencoder may be in state 4505 and transition along path 2 into state4511, or the encoder may be in state 4507 and transit along path 3 tostate 4511, or the encoder may be in state 4509 and transit into state4511. If the encoder is in state 4503, that is, state 0, at time k andthe encoder receives an input of 00, it will transition along path 1 andprovide an output of 000 as indicated in FIG. 45. If the encoder is instate 1 at time k, that is, state 4505, and the encoder receives aninput of 10, it will transition according to path 2 and output a valueof 101. If the encoder is in state 2, corresponding to state 4507 attime k, and the encoder receives an input of 11, then the encoder willtransition along path 3 into state 4511, outputting a 110. If theencoder is in state 3, corresponding to state 4509 at time k, and theencoder received an input of a 01, then the encoder will transitionalong path 4 into state 4511 and output a 011.

[0253] Therefore, to find the likelihood that the encoder is in state 0,i.e., 4511, at time k+1, it is necessary to consider the likelihood thatthe encoder was in a precursor state, that is, state 0-3, and made thetransition into state 0 at time k+1.

[0254] Likelihoods within the decoder system are based upon theEuclidian distance mean squared between a receive point and a possibletransmitted constellation point, as illustrated and discussed withreference to FIG. 35. The likelihood metrics used in the illustrativedecoder (for example, as drawn in FIG. 26) are inversely proportional tothe probability that a received point is equal to a constellation point.To illustrate the likelihood function, consider point 3501 of FIG. 35.Point 3501 represents a received signal value in the I-Q plane. Receivedpoint 3501 does not correspond to any point in the transmittedconstellation, that is, point 3503 through point 3517. Received point3501 may in have been transmitted as any of the points 3503 through3517. The likelihood that the received point 3501 is actually point 3503is equal to the Euclidian squared distance between received point 3501and point 3503. Similarly, the likelihood that received point 3501 isany of the other points within FIG. 35 is equal to the distance betweenthe received point 3501 and the candidate point squared. In other words,the metric representing the likelihood that received point 3501 is equalto a constellation point is proportional to the distance squared betweenthe received point and any constellation point. Thus, the higher valuefor the metric, representing the distance between the received point andthe constellation point, the less likely that the received point wastransmitted as the constellation point. In other words, if the distancesquared between the received point is 0, then it is highly likely thatthe received point and the constellation point are the same point. NOTE:Even though the received point may coincide with one constellationpoint, it may have been in fact transmitted as another constellationpoint, and accordingly there is always a likelihood that the receivedpoint corresponds to each of the points within the constellation. Inother words, no matter where received point 3501 is located in the I-Qplane, there is some finite likelihood that point 3503 was transmitted,there is some finite likelihood that point 3505 was transmitted, thereis some finite likelihood that point 3507 was transmitted, and so forth.Because the map decoder illustrated in the present disclosure is aprobabilistic decoder, all the points within a decoding trellis, such asillustrated at 45, have some likelihood. An iterative decoder generallyassigns likelihoods to each of the given points and only in the lastiteration are the likelihood values, that is, soft values, turned intohard values of 1 or 0. Probabilistic decoders in general make successiveestimates of the points received and iteratively refine the estimates.Although there are many different ways of representing the probabilityor likelihood of points, for example Hamming distances, the decoder ofthe present embodiment uses the Euclidian distance squared. The Min*operation is described and illustrated later in this disclosure.

[0255] Because the Euclidean distance squared is used as the likelihoodmetric in the present embodiment of the decoder the higher value for thelikelihood metrics indicate a lower probability that the received pointis the constellation point being computed. That is, if the metric of areceived point is zero then the received point actually coincides with aconstellation point and thus has a high probability of being theconstellation point. If, on the other hand, the metric is a high valuethen the distance between the constellation point and the received pointis larger and the likelihood that the constellation point is equal tothe received point is lower. Thus, in the present disclosure the term“likelihood” is used in most cases. The term “likelihood” as used hereinmeans that the lower value for the likelihood indicates that the pointis more probably equal to a constellation point. Put simply within thepresent disclosure “likelihood” is inversely proportional toprobability, although methods herein can be applied regardless ifprobability or likelihood is used.

[0256] In order to decide the likelihood that the encoder ended up instate 4511 (i.e. state 0) at time k+1, the likelihood of being in state0-3 must be considered and must be multiplied by the likelihood ofmaking the transition from the precursor state into state 4511 andmultiplied by the a priori probability of the input bits. Although thereis a finite likelihood that an encoder in state 0 came from state 0.There is also a finite likelihood that the encoder in state 0 had beenin state 1 as a precursor state. There is also a finite likelihood thatthe encoder had been in state 2 as a precursor state to state 0. Thereis also a finite likelihood that the encoder had been in state 3 as aprecursor state to state 0. Therefore, the likelihood of being in anygiven state is a product with a likelihood of a precursor state and thelikelihood of a transition from that precursor state summed over allprecursor states. In the present embodiment there are four events whichmay lead to state 4511. In order to more clearly convey the method ofprocessing the four events which may lead to state 4511 (i.e. state 0)will be given the abbreviations A, B, C and D. Event A is the likelihoodof being in state 4503 times the likelihood of making the transitionfrom state 4503 to 4511. This event can be expressed asα_(k)(0)×δ_(k)(00)×the a priori probability that the input is equal to00. α_(k)(0) is equal to the likelihood of being in state 0 at time k.δ_(k)(00) is the likelihood, or metric, of receiving an input of 00causing the transition from α_(k)(0) to α_(k+1)(0). In like manner EventB is the likelihood of being in state 4505 times the likelihood ofmaking the transition from state 4505 to state 4511. In other words,α_(k)(1)×δ_(k)(10)×the a priori probability that the input is equal to10. Event C is that the encoder was in state 4507 at time=k and made thetransition to state 4511 at time=k+1. Similarly, this can be statedα_(k) (2) * δ_(k)(11)×the a priori probability that the input is equalto 11. Event D is that the encoder was in state 4509 and made thetransition into state 4511. In other words, α_(k)(3) * δ_(k)(01)×the apriori probability that the input is equal to 01.

[0257] The probability of being in any given state therefore, which hasbeen abbreviated by alpha, is the sum of likelihoods of being in aprecursor state times the likelihood of transition to the given stateand the a priori probability of the input. In general, probabilisticdecoders function by adding multiplied likelihoods.

[0258] The multiplication of probabilities is very expensive both interms of time consumed and circuitry used as when considered withrespect to the operation of addition. Therefore, it is desirable tosubstitute for the multiplication of likelihoods or probabilities theaddition of the logarithm of the probabilities or likelihoods which isan equivalent operation to multiplication. Therefore, probabilisticdecoders, in which multiplications are common operations, ordinarilyemploy the addition of logarithms of numbers instead of themultiplications of those numbers.

[0259] The probability of being in any given state such as 4511 is equalto the sum probabilities of the precursor states times the probabilityof transition from the precursor states into the present state times thea prior probability of the inputs. As discussed previously, event A isthe likelihood of being in state 0 and making the transition to state 0.B is the event probability equivalent to being in state 1 and making thetransition to state 0. Event C is the likelihood of being in state 2 andmaking the transition to state 0. Event D is the likelihood of being instate 3 and making the transition into state 0. To determine thelikelihood of all the states at time k+1 transitions must be evaluated.That is there are 32 possible transitions from precursor states into thecurrent states. As stated previously, the likelihoods or probabilitiesof being in states and of having effecting certain transitions are allkept within the decoder in logarithmic form in order to speed thedecoding by performing addition instead of multiplication. This howeverleads to some difficulty in estimating the probability of being in agiven state because the probability of being in a given state is equalto the sum of events A+B+C+D as previously stated. Ordinarily theseprobabilities of likelihoods would be simply added. This is not possibleowing to the fact that the probability or likelihoods within the decoderare in logarithmic form. One solution to this problem is to convert thelikelihoods or probabilities from logarithmic values into ordinaryvalues, add them, and then convert back into a logarithmic values. Asmight be surmised this operation can be time consuming and complex.Instead an operation of Min* is used. The Min* is a variation of themore common operation of Max*. The operation of Max* is known in theart. Min* is an identity similar to the Max* operation but is one whichmay be performed in the present case on log likelihood values. The Min*operation is as follows.

Min*(A,B)=Min(A,B)−In(1+e ^(−|A−B|))

[0260] The Min* operation can therefore be used to find the sum oflikelihoods of values which are in logarithmic form.

[0261] Finally, the likelihood of being in state 4511 is equal to theMin* (A,B,C,D). Unfortunately, however, Min* operation can only take 2operands for its inputs. Two operands would be sufficient if the decoderbeing illustrated was a bit decoder in which there were only twoprecursor states for any present state. The present decoder is of a typeof decoder, generally referred to as a symbol decoder, in which thelikelihoods are evaluated not on the basis of individual bits input tothe encoder, but on the basis of a combination, in this case pairs, ofbits. Studies have shown that the decoding is slightly improved in thepresent case when the decoder is operated as a symbol decoder over whenthe decoder is operated as a bit decoder. In reality the decoder asdescribed is a hybrid combination symbol and bit decoder.

[0262]FIG. 46A is a graphical illustration of a method for applying theMin* operation to four different values. The configuration of FIG. 46Aillustrates a block diagram of a method for performing a Min* operationon four separate values, A, B, C and D. As indicated in FIG. 46A atiming goal of the operation in one particular embodiment is to be ableto perform a Min* operation on four operands within five nanoseconds.

[0263]FIG. 46B is a graphical illustration further illustrating the useof the Min* operation. The Min* operation (pronounced Min star) is a twooperand operation, meaning that it is most conveniently implemented as ablock of circuitry having 2 input operands. In order to perform a Min*operation on more than two operations it is convenient to construct aMin star structure. A Min* structure is a cascade of two input Min*circuits such that all of the operands over which the Min* operation isto be performed enter the structure at one point only. The structurewill have only one output which is the Min* performed over all theoperands, written Min*(operand 1, operand 2 . . . operand N), where N isthe number of operands. Min* structures may be constructed in a varietyof ways. For example a Min* operation performed over operands A, B, Cand D may appear as shown at 4611, 4613, or in several otherconfigurations. Any Min* structure will provide the correct answer overthe operands, but as illustrated in FIG. 46A Min* structures may havedifferent amounts of propagation delay depending on how the two operandMin* blocks are arranged. In an illustrative embodiment the Min*structure 4611 can meet a maximum delay specification of 5 nanoseconds,while the Min* structure 4613 cannot. This is so because structure 4611is what is known as a “parallel” structure. In a parallel Min* structurethe operands enter the structure as early as possible. In a parallelstructure the overall propagation delay through the structure isminimized.

[0264]FIG. 46B the Min* configuration of FIG. 46A with the values for A,B. C, and D substituted, which is used to determine α_(k+1)(0), that isthe likelihood of being in state 0. The Four inputs to the Min*operation (that is A, B, C and D) are further defined in FIG. 46B. The Aterm is equal to α_(k)(0) plus δ(0, 0, 0, 0), which is a metriccorresponding to the generation of an output of 000 i.e., the metricvalue calculated by the metric calculator, plus the a priori likelihoodthat bit 1 equal to 0 was received by the encoder plus the priorilikelihood that bit 0 equal 0 was received by the encoder. Because allthe values illustrated are in logarithmic scale adding the valuestogether produces a multiplication of the likelihood.

[0265] Similarly, B=α_(k)(1)+δ(1, 0, 1)+a priori (bit 1=1)+a priori (bit0=0)

[0266] Similarly C=α_(k)(2)+δ(1, 1, 0)+a priori (bit 1=1)+a priori (bit0=1)

[0267] Similarly D=α_(k)(3)+δ(0, 1, 1)+a priori (bit 0=1)+a priori (bit0=0).

[0268]FIG. 46B illustrates that prior to being able to perform a Min*operation on the four quantifies A, B, C and D several sub quantitiesmust be added. For example, in order to obtain the value A to provide itto the Min* operations the values of α_(k)(0) must be added to themetric value δ(0, 0, 0) plus the a priori probability that bit 1=0 plusthe a priori probability that bit 0=0. One way to add quantities is in acarry ripple adder as illustrated in FIG. 47.

[0269]FIG. 47 is a graphical illustration of two methods of performingelectronic addition. The first method of performing electronic additionis through the use of the carry ripple adder. A carry ripple adder hasbasically three inputs. Two inputs for each bit to be added and acarry-in input. In addition to the three inputs the carry ripple adderhas two outputs, the sum output and a carry-out output. Traditionallythe carry-out output is tied to the carry in input of the nextsuccessive stage. Because the carry-out output from one stage is coupledto the carry-in input of a second stage the carry must ripple throughthe adders in order to arrive at a correct result. Performing thecalculation illustrated at 4709 using a ripple carry adder four stagesof ripple carry adders must be employed. These stages are illustrated at4701, 4703, 4705 and 4707. It is obvious from the diagram that in orderfor a correct output to be achieved by a ripple carry adder a carry mustripple, or be propagated from the carry-out of ripple carry adder 4701through ripple carry adder 4703, through ripple carry adder 4705 andfinally into ripple carry adder 4707. Because the carry ripples earlierstages must complete their computation before the later stages canreceive a valid input for the carry in and thus compute a valid output.In contrast using the process of carry sum addition can speed theaddition process considerably. So in order to perform the addition 4709,carry save addition is performed using the format at 4711. Carry sumaddition is a process known in the art. Carry ripple addition 4705 musthave the final value ripple through 4 carry ripple adders in order toproduce a valid result. In contrast with the carry sum adder, thecomputation of the sum and carry can be carried out simultaneously.Computation of the sum and carry equation will take only one delayperiod each. It should be obvious that a carry sum adder does notproduce an output that is dependent on the numbers of digits being addedbecause no ripple is generated. Only in the last stage of carry save addwill a carry ripple effect be required. Therefore, the computationillustrated in FIG. 48B may be speeded up through the substitution of acarry look ahead for a ripple carry type adder.

[0270]FIG. 48A is a block diagram in which a carry sum adder is added toa Min* circuit according to an embodiment of the invention. FIG. 48A isessentially a copy of the circuit of FIG. 46B with the addition of carryripple adder 4801 and carry save adder 4803. The carry ripple adder 4801performs a carry sum add on the likelihood that an a priori (bit 0=0),the likelihood that an a priori (bit 1=0) and the likelihood of thetransition metric Δ(0,0,0). The inputs for carry ripple adder 4801 maybe added in carry sum adder 4803, however, since the inputs to the carryripple adder are available earlier than the inputs to carry sum adder4801, they may be precomputed thereby increasing the speed of theoverall circuit. In addition, in FIG. 48A the output of the Min*operation has been split into two outputs.

[0271]FIG. 48B is a block diagram in which a carry sum adder is added toa Min* circuit according to an embodiment of the invention. In FIG. 48Bregister 4807 has been added. Register 4807 holds the values of theadder until they are needed in the Min* block 4805. Since the inputs toadder 4801 re available before other inputs they can be combined to forma sum before the sum is needed thereby shortening the computation timeover what would be the case if all the operands were combined only whenthey were all available. Register 4809 can hold values Ln_α_(k) andMin_α_(k) until they are needed. Carry look ahead adder 4803 is broughtinside the Min* block. Carry look ahead Adder is the fastest form ofaddition known. In addition, in FIG. 48B like FIG. 48A the output of theMin* operation has been split into two outputs.

[0272] The splitting of the Min*output will be illustrated in successivedrawings. To understand why the outputs of the Min* is split into twoseparate outputs it is necessary to consider a typical Min* typeoperation. Such a typical Min* operation is illustrated in FIG. 49. FIG.49 is an implementation of the Min* operation. In FIG. 49 two inputs4901 and 4903 receive the values on which the Min* operation is to beperformed. The values 4901 and 4903 are then subtracted in a subtractor4905. Typically such a subtractor will involve negating one of theinputs and adding it to the other input. The difference between the Aand B input is then provided at output 4907. The difference value Δ isused in both portions of the Min* operation. That is the sign bit of Δis used to select which of the inputs A or B is the minimum. This inputis then selected in a circuit such as multiplexer 4909. Multiplexer 4909is controlled by the sign bit of the Δ. The output of multiplexer 4909is the minimum of A, B. In addition, the Δ is used in the logcalculation of Ln(1+e^(−|Δ|)) The output of the log calculation block4913 is then summed with the minimum of A and B and the resultingsummation is the Min* of A, B. This operation too can be sped up byeliminating the adder 4911. Instead of making an addition in adder 4901,the output of the log calculation block 4913, also designated asLn_α_(k)(0) and the output of multiplexer 4909 abbreviated asMin_α_(k)(0). By eliminating the addition in 4911 the operation fo theMin* will be speeded up. The addition operation must still be performedelsewhere. The addition operation is performed within the Min* block4805 in a carry save adder 4803 as illustrated in FIG. 48A.

[0273] With respect to FIG. 49, although the output of the Min*operator, that is Ln_α_(k)(0), i.e. 4915 and Min_α_(k)(0), i.e. 4917 notcombined until they are combined in adder 4911 two outputs are combinedin block 4911 and form the α_(k)(0) values 4913. The values 4913represent the values that are pushed on to stack 4019. As such, theoperation 4911 can be relatively slow since the α values are beingpushed on a stack for later usage in any instance. In other words, theoutput of the Min* circuit of FIG. 49 is calculated twice. The firstinstance is the output of the log block 4913 and the multiplexer block4909 are maintained as integral outputs 4915 and 4917. The integraloutputs 4915 and 4917 are fed back to the input of the Min* where theyare combined with other values that are being added.

[0274]FIG. 50A is a graphical illustration of a portion of two Min*circuits illustrated generally at 5001 and 5003. In the circuit of 5001A and B are combined but it is assumed that B is larger than A and thevalue Δ will always be positive. In the second circuit it is assumedthat the value of A will be larger than B and hence the Δ in circuit5003 will always be positive. It is obvious that both assumptions cannotbe correct. It is also obvious that one of the two assumptions must becorrect. Accordingly, the circuit is duplicated and then a mechanism,which will be described later, is used to select the circuit that hasmade the correct assumption. Assuming both positive and negative valuesfor Δ the process of computation of the log quantity of 5005 or 5007 canstart when the first bit is produced by the subtraction of A and B. Inother words, it is not necessary for the entire value to be computed inorder to start the calculations in blocks 5005 and 5007. Of course, oneof the calculations will be incorrect, and will have to be discarded.Once the least significant bit has been produced by the subtraction of Aand B, the least significant bit of Δ can be placed in the calculationblock 5005 or 5007 and the log calculation started. By not waiting untilthe entire Δ value has been produced, the process of computation can befurther speeded up.

[0275]FIG. 50B is a graphical illustration of a portion of two Min*circuits illustrated generally at 5001 and 5003. It is a variation ofthe circuit of FIG. 50A and either circuit may be used for the describedcomputation.

[0276] Once the value of Δ 5107 is computed, it can be used in thecalculation in block 5113. In order to properly compute the value inblock 5113, the value of Δ needs to be examined. Since block 5113 thecomputation takes longer than the process of operating the multiplexer5009 with the sign bit of the δ value of 5007. Since there is no way todetermine a priori which value will be larger A or B, there is no way toknow that the value of Δ will always be positive. However, although itis not known a priori which will be larger A or B duplicate circuits canbe fabricated based on the assumption that A is larger than B and asecond assumption that B is larger than A. Such a circuit is illustratedin FIG. 50.

[0277] β values to be calculated in a similar fashion to the a value andall comments with respect to speeding up a calculations pertain to βcalculations. The speed of the a computation and the speed of the betacomputation should be minimized so that neither calculation takessignificantly longer than the other. In other words, all speed-uptechniques that are applied to the calculation of α values may beapplied to the calculation of beta values in the reverse direction.

[0278] The calculation of the logarithmic portion of the Min* operationrepresents a complex calculation. The table of FIG. 51A illustrates alook-up table implementation of the log function. Realizing a functionby using a look-up table is one way of speeding a complex mathematicalcalculation. In the table it is seen that any value of delta larger than1.25 or smaller than 1.25 will result in a log output equal to point 5.Therefore, instead of actually calculating the value of the logarithmicportion of the Min* the table of FIG. 51A can be used. The table of 51Aequivalently can be realized by logic equations 1 and 2. Equation 1represents the positive Δ values of the table of 51A and equation 2representing the negative Δ values of table 51A.

Log−out=−log (Δ)+0.5=Δ(1) AND Δ(2)  Equation 1

Log−out=−log (−Δ)+0.5=(Δ(0) AND Δ(1)) NOR Δ(2)  Equation 2

[0279] Those skilled in the art will realize that any equivalent booleanexpression will yield the same result, and that the lookup table may beequivalently replaced by logic implementing Equations 1 and 2 or theirequivalents.

[0280]FIG. 51A is a log table which contain look-up value for thecalculation of the log portion of the Min* operation. The table of FIG.51A also illustrates that the value of delta need only be known to theextent of its three least significant bits. Blocks 5109 and 5111 in FIG.51 represent the calculation of the logarithm of the minus delta valueand the calculation logarithm of the plus delta value. The validcalculation, between 5109 and 5111, is selected by multiplexer 5115 andOR gate 5117. The output of log saturation circuit 5113 is a 1 if allinputs are not equal to logic zero and all inputs are not equal to logicone.

[0281] Multiplexer 5105 also is controlled by the value of delta as ismultiplexer 5115. Multiplexer 5115 can be controlled by bit 3 of delta.(Any error caused by the selection of the wrong block 5109 or 5111 byusing Δ bit 3 instead of Δ 9, the sign bit, is made up for in the logsaturation block 5113. How this works can be determined by consider FIG.51B.

[0282]FIG. 51B is a graphical illustration of a table used in the logsaturation of FIG. 51. In RANGE#2 and RANGE#4 where in_out is 0, Δ 3selects the right range for in_out (i.e., when it's 0, it select log(+value) for in/out to be 0, and when it's 1 it selects log(−value) forin_out to be 0). In RANGE#1 (i.e., +value), when Δ 3 changes from 0 to1, this would select incorrectly log(−value) for the mux output.However, the selected (mux) output is overwritten at the OR gate by theLog Saturation block. This Log Saturation block detects that Δ 8:3 isnot all 0's (e.g., it's 000001) then it would force the in_out to be 1which is the right value of RANGE#1.

[0283] Similarly, for RANGE#4 (i.e., −value), when Δ 3 changes from 1 to0, it would select in correctly the log (+value) for the mux output.However, the selected (mux) output is overwritten at the OR gate by theLog Saturation block. This Log Saturation block detects that Δ 8:3 isnot all 1's (e.g., it's 111110) when it would force the in/out to be 1which is the right value for RANGE #4. The sign bit of Δ controlswhether A or B is selected be passed through the output. The input tothe A and B adders 5101 and 5103 are the same as that shown in FIG. 48A.A and B form sums separately so that the correct sum may be selected bymultiplexer 5105. In contrast the carry sum adder 5107 can accept allthe inputs to A and B in order to calculate Δ. Of course, one of theinputs must be in two's compliment form so that the subtraction of Aminus B can be accomplished. In other words, either the A or B valuescan be negated and two's complimented and then add to the other valuesin order to form the Δ value. The negating of a value is a simple onegate operation. Additionally, the forming of a two's compliment byadding one is relatively simple because in the carry sum addition firststage is assumed to have a carry of zero. By assuming that that carry isequal to one instead of a zero a two's complimentary value can be easilyformed.

[0284]FIG. 52A is a graphical illustration and circuit diagramindicating a way in which α values within the SISO may be normalized. Asthe α values within the SISOs tend to converge the values in theregisters patrol the α values have a tendency to grow betweeniterations. In order to keep the operation fo the SISO as economical aspossible in terms of speed and memory usage, the value stored in the αregister should be kept as small as only needed for the calculations tobe performed. One method of doing this is the process callednormalization. The process of normalization in the present embodimentoccurs when the high order bit of the value in all the α registers isa 1. This condition indicates that the most significant bit in each αregister is set. Once the condition where all of the most significantbits in all of the α registers are set then all of the most significantbits can be reset on the next cycle in order to subtract a constantvalue from each of the values within the α registers. Such a process canbe done using subtraction of course, but that would involvesubstantially more delay and hardware. The process illustrated in FIG.52 involves only one logic gate being inserted into the timing criticalpath of the circuit. Once the all most significant α bits condition isdetected by AND gate 5201 multiplexer 5203 can be activated. Multiplexer5203 may be implemented as a logic gate, for example, an AND gate. BitsB₀ through B₈ are provided to the α₀ register. Either B₉ or a zero isprovided to the α₀ register depending on the output of AND gate 5201.Accordingly, only 1 gate delay is added by normalizing the α values. Insuch a manner a constant value can be subtracted from each of the αregisters without increasing any cycle time of the overall decodercircuit.

[0285]FIG. 52B is a graphical illustration and circuit diagramindicating an alternate way in which α values within the SISO may benormalized. The circuit is similar to that illustrated in FIG. 52A. Themultiplexor 5203 selects only bit 9 (the most significant bit, as abeing passed through or being normalized to 0.

What is claimed is:
 1. A method for encoding an information signal themethod comprising: nonsystematically encoding the information signal;interleaving the information signal to form an interleaved informationsignal; and encoding the interleaved information signal.
 2. The methodas in claim 1 wherein encoding the interleaved information signalfurther comprises nonsystematically encoding the interleaved informationsignal.
 3. The method as in claim 2 wherein the encoding furthercomprises convolutionally encoding.
 4. The method as in claim 1 wherenonsystematically encoding further comprises recursively encoding. 5.The method as in claim 1 wherein the interleaving comprises even-oddinterleaving.
 6. The method as in claim 1 wherein the interleavingcomprises bit interleaving.
 7. The method as in claim 5 furthercomprising: selecting an odd encoding from the encoded informationsignal; selecting an even encoding from the encoded interleavedinformation signal; and concatenating the selected odd encoding to theselected even encoding to form a composite signal.
 8. The method as inclaim 5 further comprising: selecting an even encoding from the encodedinformation signal; selecting an odd encoding from the encodedinterleaved information signal; and concatenating the selected oddencoding to the selected even encoding to form a composite signal. 9.The method as in claim 7 further comprising mapping the composite signalin a signal mapper.
 10. The method as in claim 8 further comprisingmapping the composite signal in a signal mapper.
 11. A method forencoding an information signal comprising: encoding the informationsignal; interleaving the information signal to form an interleavedinformation signal; and nonsystematically encoding the interleavedinformation signal.
 12. The method as in claim 11 wherein encoding theinterleaved information signal further comprises nonsystematicallyencoding the interleaved information signal.
 13. The method as in claim12 wherein encoding further comprises convolutionally encoding.
 14. Themethod as in claim 11 where nonsystematically encoding further comprisesrecursively encoding.
 15. The method as in claim 11 wherein theinterleaving comprises even-odd interleaving.
 16. The method as in claim11 wherein the interleaving comprises bit interleaving.
 17. The methodas in claim 15 further comprising: selecting an odd encoding from theencoded information signal; selecting an even encoding from the encodedinterleaved information signal; and concatenating the selected oddencoding to the selected even encoding to form a composite signal. 18.The method as in claim 14 further comprising: selecting an even encodingfrom the encoded information signal; and selecting an odd encoding fromthe encoded interleaved information signal; and concatenating theselected odd encoding to the selected even encoding to form a compositesignal.
 19. A method for encoding an information signal comprising:encoding the information signal; modulo-N interleaving the informationsignal, where N is an integer greater than one; and encoding the modulointerleaved information signal.
 20. The method as in claim 19 whereinencoding the interleaved information signal further comprisesnonsystematically encoding the interleaved information signal.
 21. Themethod as in claim 19 wherein encoding the interleaved informationsignal further comprises nonsystematically encoding the interleavedinformation signal.
 22. The method as in claim 19 further comprising:selecting alternately between the encoded information signal and theinterleaved information signal; and accepting the selected encoding in amapper.
 23. The method as in claim 19 wherein the encoding furthercomprises recursively encoding.
 24. The method as in claim 19 whereinthe encoding further comprises convolutionally encoding.
 25. The methodas in claim 19 wherein the interleaving comprises bit interleaving. 26.The method as in claim 19 further comprising: selecting a first encodingfrom the encoded information signal; and selecting N−1 encodings fromthe modulo-N encoded interleaved information signal; and accepting theselected encoding in a mapper.
 27. The method as in claim 19 wherein theinterleaving further comprises srandom interleaving.
 28. The method asin claim 19 wherein the interleaving further comprises randominterleaving.
 29. The method as in claim 19 wherein the interleavingfurther comprises block interleaving.
 30. A method for parallelconcatenated encoding an information signal, the method comprising:turbo trellis encoding an information signal; and mapping the encodedinformation signal in a first mapper; and concatenating the encodedsignal mapped in the first mapper with another signal mapped in a secondmapper.
 31. The method as in 30 wherein the turbo trellis encoding aninformation signal comprises nonsystematically encoding the informationsignal in a constituent encoder.
 32. The method as in 30 wherein theturbo trellis encoding an information signal comprises recursivelyencoding the information signal in a constituent encoder.
 33. The methodas in 30 wherein the turbo trellis encoding an information signalcomprises convolutionally encoding the information signal in aconstituent encoder.
 34. The method as in 30 wherein the turbo trellisencoding an information signal comprises even-odd interleaving theinformation signal in an even-odd interleaver.
 35. The method as in 30wherein the turbo trellis encoding an information signal comprisesmodulo-N interleaving, where N is greater than 2, the information signalin a modulo-N interleaver.
 36. The method as in 30 wherein the turbotrellis encoding an information signal comprises ST even/oddinterleaving the information signal in an even/odd interleaver.
 37. Themethod as in 30 wherein the turbo trellis encoding an information signalcomprises ST modulo-N interleaving, where N is greater than 2, theinformation signal in a modulo-N interleaver.
 38. The method as in 30wherein the turbo trellis encoding an information signal comprisesinterleaving the information signal before providing it to a constituentencoder.
 39. The method as in claim 38 wherein the interleavingcomprises modulo interleaving.
 40. The method as in claim 38 wherein theinterleaving comprises ST interleaving.
 41. The method as in 30 whereinconcatenating the encoded signal mapped in the first mapper with anothersignal mapped in a second mapper comprises: puncturing a portion of theencoded information signal; and mapping the punctured portion of theinformation signal concatenated with a portion of the information signalin a second mapper.
 42. The method as in 30 wherein concatenating theencoded signal mapped in the first mapper with another signal mapped ina second mapper comprises: puncturing a portion of the encodedinformation signal; and mapping a portion of the information signal in asecond mapper.
 43. A method for interleaving a first block of datatuples to create a second block of data tuples, the method comprising:identifying a modulo sequence designation for each data tuple in thefirst block; and interleaving the data tuples from the first block intopositions in the second block having the same modulo sequencedesignation.
 44. The method of claim 43 wherein the bits of each datatuple from the first block are interleaved independently into positionsin the second block.
 45. The method of claim 44 wherein the bits of eachdata tuple from the first block are interleaved into tuples in thesecond block having the same position of significance within the tuple.46. A method for encoding data tuples comprising: ST interleaving thedata tuples in a first even-odd interleaver; encoding in a first encoderthe data tuples interleaved in the first interleaver; ST interleavingthe data tuples in a second even-odd interleaver; encoding in a secondencoder the data tuples interleaved in the second interleaver; andselecting encoded tuples alternatively from the first and secondencoder.
 47. The method as in claim 46 wherein the encoding in a firstencoder further comprises nonsystematically encoding in a first encoder.48. The method as in claim 46 wherein the encoding in a second encoderfurther comprises nonsystematically encoding in a second encoder.
 49. Amethod for encoding data tuples, the method comprising: encoding thedata tuples in a first encoder; interleaving the data tuples in aneven/odd interleaver; encoding the interleaved tuples in a secondencoder; and selecting encoded tuples alternatively from the first andsecond encoder.
 50. The method as in claim 49 wherein the encoding in afirst encoder further comprises nonsystematically encoding in a firstencoder.
 51. The method as in claim 49 wherein the encoding in a secondencoder further comprises nonsystematically encoding in a secondencoder.
 52. The method as in claim 49 wherein the interleavingcomprises ST interleaving.
 53. The method as in claim 49 furthercomprising mapping the alternatively selected tuples in a mapper.
 54. Amethod of encoding data symbols the method comprising dividing a datatuple into a sequential sequence of equally sized tuples of N inputbits, the tuples being of size N regardless of the size of the datatuple: and turbo trellis modulated encoding the equally sized tuples.55. The method as in claim 54 wherein turbo trellis modulated encodingthe tuples further comprises: modulo interleaving the tuples; encodingthe modulo interleaved tuples; and modulo selecting the encoded tuples.56. A method for producing a code from a sequence of tuples the methodcomprising: encoding the sequence of tuples in a first encoding; modulointerleaving the input tuples in at least one interleaving; encoding themodulo interleaved tuples in at least one encoding; selecting theencoded tuples sequentially from each encoding; and mapping the selectedtuples in at least one mapper.
 57. The method as in claim 56 whereinencoding the sequence of tuples in a first encoder comprisessystematically encoding the sequence of tuples in a first encoding. 58.The method as in claim 56 wherein encoding the sequence of tuples in afirst encoder comprises nonsystematically encoding the sequence oftuples in a first encoding.
 59. The method as in claim 56 whereinencoding the sequence of tuples in a first encoding comprisesconvolutionally encoding the sequence of tuples in a first encoding. 60.The method as in claim 56 wherein encoding the sequence of tuples in afirst encoding comprises recursively encoding the sequence of tuples ina first encoding.
 61. The method as in claim 56 wherein modulointerleaving the input tuples in at least one interleaving comprises STinterleaving.
 62. The method as in claim 56 wherein encoding the modulointerleaved tuples in at least one encoding comprises systematicallyencoding the sequence of N tuples.
 63. The method as in claim 56 whereinencoding the modulo interleaved tuples in at least one encodingcomprises nonsystematically encoding.
 64. The method as in claim 56wherein encoding the modulo interleaved tuples in at least one encodingcomprises convolutionally encoding.
 65. The method as in claim 56wherein encoding the modulo interleaved tuples in at least one encodingcomprises recursively encoding.
 66. The method as in claim 56 whereinselecting the encoded tuples sequentially from each encoding comprisespuncturing at least one bit from an encoding.
 67. The method as in claim66 wherein the puncturing at least one bit from an encoding furthercomprises substituting at least one uncoded bit for the at least one bitpunctured from the encoding.
 68. A method for creating a parallelconcatenated code having a higher rate than the constituent encodingsthe method comprising: TTCM encoding information tuples; mapping a firstportion of the encoded information tuples in a first mapping; puncturinga second portion of the encoded tuples and substituting uncoded tuples;mapping the uncoded tuples in a second mapping.
 69. A method forselecting mappings in a TTCM encoder the method comprising: selectingnon-Ungerboeck mappings; computing the average effective distancebetween code words in each mapping; and selecting the non-Ungerboeckmapping which has approximately the greatest effective distance betweencode words.
 70. A method for generating a modulo-N interleaving sequencethe method comprising: selecting a range of addresses from 0 to M for aseed interleaving sequence; creating N interleaving sequences from theseed sequence; creating a first sequence by selecting elementssequentially from the N interleaving sequences; multiplying each elementin the first sequence by N to create a second sequence; adding theelement position modulo-N to each element in the second sequence togenerate the modulo-N interleaving sequence.
 71. The method as in claim70 herein an interleaving sequence is created from the seed sequence byusing the inverse sequence of the seed sequence.
 72. The method as inclaim 70 wherein an interleaving sequence is created from the seedsequence by using the time reversal of the seed sequence.
 73. The methodas in claim 70 wherein an interleaving sequence is created from the seedsequence by using the inverse of the time reversal of the seed sequence.74. A method for communicating data the method comprising: modulo-Nturbo-encoding the data; communicating the data across a channel; andmodulo-N decoding the data.
 75. The method as in claim 74 whereinmodulo-N turbo-encoding the data comprises modulo-N turbo-trellisencoding the data.
 76. The method as in claim 74 wherein modulo-Nturbo-encoding the data comprises: interleaving the data N+1 times; andencoding the data N+1 times in constituent encoders.
 77. The method asin claim 74 wherein modulo-N turbo-encoding the data comprises:interleaving the data N times; and encoding the data N+1 times inconstituent encoders.
 78. The method as in claim 76 herein interleavingcomprises ST interleaving.
 79. The method as in claim 77 whereininterleaving comprises ST interleaving.
 80. The method as in claim 74wherein modulo-N decoding the data comprises modulo-N parallel decodingthe data.
 81. A method for creating a higher rate code from a lower rateencoder constituent encoder, the method comprising: turbo trellis codemodulation modulo-N encoding an input sequence of tuples to produce anoutput sequence of tuples; and puncturing the output sequence andsubstituting uncoded input sequence tuples for corresponding encodedoutput sequence tuples.
 82. The method as in claim 81 wherein theturbo-trellis coded modulation modulo-N encoding comprises ST encoding.83. The method as in claim 81 wherein the turbo-trellis coded modulationmodulo-N encoding comprises interleaving the input sequence in Nmodulo-N interleavers and encoding the resulting N interleaved sequencein N encoders.
 84. A method for selecting a constellation mapping for aTurbo-Trellis Encoder. selecting non-Ungerboeck mappings; determiningthe effective minimum distance of code words in the non-Ungerboeckmappings; and selecting the non-Ungerboeck mapping having code wordswith the largest effective average distance form each other;
 85. Amethod of encoding data tuples the method comprising: encoding the datatuples with a Reed-Solomon; and turbo trellis encoding the tuplesencoded with the Reed-Solomon code.
 86. The method as in claim 85wherein turbo trellis encoding the tuples further comprises turbotrellis modulo-N encoding the tuples.
 87. The method as in claim 86wherein turbo trellis encoding the tuples comprises ST interleaving thetuples.
 88. The method as in claim 86 wherein turbo trellis encoding thetuples comprises ST interleaving the tuples prior to providing them toany constituent encoder.
 89. An apparatus for encoding an informationsignal the apparatus comprising: a nonsystematic encoder that accepts aninformation signal; an interleaver that interleaves the informationsignal to form an interleaved information signal; and an encoder thatencodes the interleaved information signal.
 90. The apparatus of claim89 wherein the encoder that encodes the interleaved information signalis a nonsystematic encoder.
 91. The apparatus of claim 89 wherein theencoder further comprises a convolutional encoder.
 92. The apparatus ofclaim 89 where nonsystematic encoder further comprises a recursiveencoder.
 93. The apparatus of claim 89 where the interleaver comprisesan even-odd interleaver.
 94. The apparatus of claim 89 where theinterleaver comprises a bit interleaver.
 95. The apparatus of claim 93further comprising: a selector that selects an odd encoding from theencoded information signal, and an even encoding from the encodedinterleaved information signal; and means for concatenating the selectedodd encoding to the selected even encoding to form a composite signal.96. The apparatus of claim 95 further comprising a signal mapper thataccepts the composite signal.
 97. An apparatus for encoding aninformation signal the apparatus comprising: an encoder that encodes theinformation signal; an interleaver that interleaves the informationsignal to form an interleaved information signal; and a nonsystematicencoder that encodes the interleaved information signal.
 98. Theapparatus of claim 98 wherein the nonsystematic encoder comprises aconvolutional encoder.
 99. The apparatus of claim 98 wherein thenonsystematic encoder comprises a recursive encoder.
 100. The apparatusof claim 98 wherein interleaver comprises an odd-even interleaver. 101.The apparatus of claim 98 wherein interleaver comprises a bitinterleaver.
 102. The apparatus of claim 100 further wherein the moduloN interleaver is an even odd interleaver.
 103. An apparatus for encodingan information signal the apparatus comprising: an encoder that encodesthe information signal; a modulo-N interleaver that encodes theinformation signal, where N is an integer greater than one; and anencoder that encodes the modulo interleaved information signal.
 104. Theapparatus of claim 103 wherein the encoder that encodes the interleavedinformation signal further comprises a nonsystematic encoder.
 105. Theapparatus of claim 103 wherein the encoder that encodes the interleavedinformation signal further comprises a nonsystematic encoder.
 106. Theapparatus of claim 103 further comprising: a selector that alternatelyselects between the encoded information signal and the interleavedinformation signal and provides the result as a concatenated signal; anda mapper that accepts the concatenated signal and performs a mapping onit.
 107. The apparatus of claim 103 wherein the encoder comprises arecursive encoder.
 108. The apparatus of claim 103 wherein the whereinthe encoder comprises a convolutional encoder.
 109. The apparatus ofclaim 103 wherein the wherein the interleaver comprises a bitinterleaver.
 110. The apparatus of claim 103 further comprising: aselector that selects a first encoding from the encoded informationsignal; and selects N−1 encodings from the modulo-N encoded interleavedinformation signal; and a mapper that accepts selected encodings fromthe selector.
 111. The apparatus of claim 103 wherein the interleaverfurther comprises a srandom interleaver.
 112. The apparatus of claim 103wherein the interleaver further comprises a random interleaver.
 113. Theapparatus of claim 103 wherein the interleaver further comprises a blockinterleaver.
 114. An apparatus for parallel concatenated encoding aninformation signal, the method comprising: a turbo trellis encoder thatencodes an information signal; a first mapper that accepts the encodedinformation signal; a second mapper that accepts the encoded informationsignal; a selector that selects a first signal mapped in the firstmapper and selects a second signal mapped in the second mapper; andmeans for concatenating the encoded signal mapped in the first mapperwith the signal mapped in a second mapper.
 115. The apparatus as in 114wherein the turbo trellis encoder comprises at least one nonsystematicconstituent encoder.
 116. The apparatus as in 114 wherein the turbotrellis encoder comprises at least one recursive constituent encoder.117. The apparatus as in 114 wherein the turbo trellis encoder comprisesat least one convolutional constituent encoder.
 118. The apparatus as in114 wherein the turbo trellis encoder includes an even-odd interleaver.119. The apparatus as in 114 wherein the turbo trellis encoder includesa modulo-N interleaver where N is greater than
 2. 120. The apparatus asin 114 wherein the turbo trellis encoder includes an ST even/oddinterleaver.
 121. The apparatus as in 114 wherein the turbo trellisencoder includes an ST modulo-N interleaver where N is greater than 2.122. The apparatus as in 114 wherein the turbo trellis encoder includesan interleaver prior to each constituent encoder.
 123. The apparatus asin 122 wherein the interleaver comprises a modulo interleaver.
 124. Theapparatus as in 122 wherein the interleaver comprises a modulo stinterleaver.
 125. The apparatus as in 122 wherein means forconcatenating the encoded signal mapped in the first mapper with thesignal mapped in a second mapper comprises: means for puncturing aportion of the encoded information signal; and a second mapper formapping the punctured portion of the information signal concatenatedwith a portion of the information signal.
 126. The apparatus of 114wherein means for concatenating the encoded signal mapped in the firstmapper with the signal mapped in a second mapper further comprises meansfor puncturing a portion of the encoded information signal; and meansfor mapping a portion of the information signal in a second mapper. 127.An apparatus for interleaving a first block of data tuples to create asecond block of data tuples, the apparatus comprising: means foridentifying a modulo sequence designation for each data tuple in thefirst block; and means for interleaving the data tuples from the firstblock into positions in the second block having the same modulo sequencedesignation.
 128. An apparatus for encoding data tuples the apparatuscomprising: an ST even-odd interleaver that accepts the data tuples tobe encoded; an encoder that encodes tuples output from the ST even-oddinterleaver; a second ST even-odd interleaver that accepts the datatuples to be encoded; a second encoder that encodes tuples output fromthe ST even-odd interleaver; and a selector that selects encoded tuplesalternatively from the first and second encoder.
 129. The apparatus ofclaim 128 wherein the first encoder comprises a nonsystematic encoder.130. The apparatus of claim 129 wherein the second encoder comprises anonsystematic encoder.
 131. An apparatus for encoding data tuples, theapparatus comprising: a first encoder that encodes the data tuples; anodd-even interleaver that interleaves the data tuples; a second encoderthat encodes the interleaved tuples; and a selector that selects encodedtuples alternatively from the first and second encoders therebyproviding a composite signal.
 132. The apparatus of claim 131 whereinthe first encoder further comprises a nonsystematic encoder.
 133. Theapparatus of claim 131 wherein the second encoder further comprises anonsystematic encoder.
 134. The apparatus of claim 131 wherein theinterleaver comprises an ST interleaver.
 135. The apparatus of claim 131further comprising a mapper that maps the composite signal.
 136. Anapparatus for encoding data tuples the apparatus comprising a dividerthat divides the data tuples into a sequential sequence of equally sizedtuples of N input bits, the tuples being of size N regardless of thesize of the data tuple: and a turbo trellis modulator that encodes theequally sized tuples.
 137. The apparatus as in claim 136 wherein turbotrellis modulator further comprises: at least one modulo interleaverthat interleaves equally sized tuples; at least two encoders, at leaston of which accepts interleaved tuples and a modulo selector thatselects encoded tuples from at least two encoders.
 138. An apparatusthat produces a code from a sequence of tuples the apparatus comprising:a first encoder that encodes the sequence of tuples in a first encoding;at least one modulo interleaver that interleaves the input tuples in atleast one interleaving; at least one second encoder that encodes themodulo interleaved tuples in at least one encoding; a selector thatselects encoded tuples sequentially from each encoding; and at least onemapper that maps the selected tuples.
 139. The apparatus as in claim 138wherein the first encoder comprises a systematic encoder.
 140. Theapparatus as in claim 138 wherein the first encoder comprises anonsystematic encoder.
 141. The apparatus as in claim 138 whereinencoding the sequence of tuples in a first encoding comprisesconvolutionally encoding the sequence of tuples in a first encoding.142. The apparatus as in claim 138 wherein the first encoder is arecursive encoder.
 143. The apparatus as in claim 138 wherein the atleast one modulo interleaver comprises at least one modulo STinterleaving.
 144. The apparatus as in claim 138 wherein encoding themodulo interleaved tuples in at least one encoding comprisessystematically encoding the sequence of N tuples.
 145. The apparatus asin claim 138 wherein the at least one second encoder comprises anonsystematic encoder.
 146. The apparatus as in claim 138 wherein the atleast one second encoder comprises a convolutional encoder.
 147. Theapparatus as in claim 138 wherein the at least one second encodercomprises a recursive encoder.
 148. The apparatus as in claim 138wherein a selector that selects encoded tuples sequentially from eachencoding further comprises puncturing means for puncturing at least onebit from an encoding.
 149. The apparatus as in claim 148A wherein thepuncturing means further comprises means for substituting at least oneuncoded bit for the at least one bit punctured from the encoding. 150.An apparatus that creates a parallel concatenated code having a higherrate than the constituent encodings the apparatus comprising: a TTCMencoder that accepts information tuples; a mapper that maps a firstportion of the encoded information tuples in a first mapping; puncturingmeans for puncturing a second portion of the encoded tuples andsubstituting uncoded tuples; mapper that maps the uncoded tuples in asecond mapping.
 151. An apparatus for communicating data the methodcomprising: a modulo-N turbo-encoder that accepts the data to becommunicated and produces encoded data to be communicated; means forcommunicating the encoded data to be communicated across a channel; anda modulo-N decoder that accepts and decodes the encoded data receivedfrom the channel.
 152. The apparatus of claim 151 wherein modulo-Nturbo-encoder comprises a modulo-N turbo-trellis encoder.
 153. Theapparatus of claim 151 wherein the modulo-N turbo-encoder comprises: N+1interleavers that interleave data to be communicated; and N+1 timesconstituent encoders that encode the data interleaved by the N+1interleavers.
 154. The apparatus of claim 151 wherein the modulo-Nturbo-encoder comprises: N interleavers that interleave the data to betransmitted thereby forming N interleaved versions of the data; and N+1constituent encoders that encode the data to be transmitted and theinterleaved versions of the data.
 155. The apparatus of claim 153wherein the N interleavers comprises ST interleavers.
 156. The apparatusof claim 154 wherein the N interleavers comprises ST interleavers. 157.The apparatus as in claim 151 wherein the modulo-N decoder comprises amodulo-N parallel decoder.
 158. An apparatus for creating a higher ratecode from a lower rate encoder constituent encoder, the apparatuscomprising: a turbo trellis code modulation modulo-N encoder thataccepts an input sequence of tuples and produces an output sequence oftuples; and means for puncturing the output sequence and substitutinguncoded input sequence tuples for corresponding encoded output sequencetuples.
 159. The apparatus as in claim 158 wherein the turbo-trelliscoded modulation modulo-N encoder further comprises an ST encoder. 160.The apparatus method as in claim 158 wherein the turbo-trellis codedmodulation modulo-N encoder further comprises N modulo-N interleaversthat interleave the input sequence into interleaved sequences; and Nencoders that encode the resulting interleaved sequences.
 161. Anencoder that encodes data tuples the encoder comprising: a Reed-Solomonencoder that encodes the data tuples; and a turbo trellis encoder thataccepts the tuples encoded with the Reed-Solomon encoder.
 162. Theapparatus as in claim 161 wherein the turbo trellis encoder furthercomprises a turbo trellis modulo-N encoder.
 163. The apparatus as inclaim 162 wherein turbo trellis encoder further comprises an STinterleaver.
 164. The apparatus as in claim 162 wherein turbo trellisencoder comprises ST interleavers that interleaves data tuples prior toproviding them to any constituent encoder.